-- Logs begin at Tue 2022-06-07 03:38:07 UTC, end at Tue 2022-06-07 05:16:24 UTC. -- Jun 07 04:38:01.527723 dv-cinder-836996-30-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 04:38:01.536301 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 04:38:01 2022] *** Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: nodename: dv-cinder-836996-30-iscsi Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: machine: x86_64 Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: clock source: unix Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: pcre jit disabled Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: detected number of CPU cores: 4 Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: current working directory: / Jun 07 04:38:01.538211 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: detected binary path: /usr/bin/uwsgi-core Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: your processes number limit is 47680 Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: your memory page size is 4096 bytes Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: detected max file descriptor number: 2048 Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: lock engine: pthread robust mutexes Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: thunder lock: enabled Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 04:38:01.538841 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 04:38:01.583414 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: Python main interpreter initialized at 0x561ed1f719c0 Jun 07 04:38:01.583414 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: python threads support enabled Jun 07 04:38:01.583414 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: your server socket listen backlog is limited to 100 connections Jun 07 04:38:01.583414 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: your mercy for graceful operations on workers is 90 seconds Jun 07 04:38:01.583794 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 04:38:01.583874 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: *** Operational MODE: preforking *** Jun 07 04:38:01.584117 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: *** uWSGI is running in multiple interpreter mode *** Jun 07 04:38:01.584117 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: spawned uWSGI master process (pid: 110021) Jun 07 04:38:01.584323 dv-cinder-836996-30-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 04:38:01.584893 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: spawned uWSGI worker 1 (pid: 110022, cores: 1) Jun 07 04:38:01.585349 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: spawned uWSGI worker 2 (pid: 110023, cores: 1) Jun 07 04:38:01.585840 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 04:38:02.814170 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 04:38:02.815461 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 04:38:03.536513 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:38:03.536513 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: from cryptography.utils import int_from_bytes Jun 07 04:38:03.536838 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:38:03.536838 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: from cryptography.utils import int_from_bytes Jun 07 04:38:03.537520 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:38:03.537520 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: from cryptography.utils import int_from_bytes Jun 07 04:38:03.537849 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:38:03.537849 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: from cryptography.utils import int_from_bytes Jun 07 04:38:06.130538 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 04:38:06.131143 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 04:38:06.131805 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 04:38:06.132162 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 04:38:06.132421 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 04:38:06.132809 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.133134 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.133481 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.133800 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.134129 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.134437 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.134757 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.135069 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.135392 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.135651 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.135966 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.136290 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-30-iscsi {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.136610 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.136916 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.137242 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.137567 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.137870 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.138191 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.138494 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.138987 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.140302 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.140302 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.140604 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 04:38:06.141210 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.141378 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 04:38:06.141500 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.141652 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 04:38:06.141821 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.141821 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.142095 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 04:38:06.142095 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 04:38:06.142355 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.142355 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.142719 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.142840 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.142990 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143144 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143266 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143266 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143542 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-30-iscsi {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143720 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.143929 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.144156 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.144520 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.144685 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.144818 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.144937 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145057 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145186 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145305 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145439 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145524 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145623 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145706 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145838 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-30-iscsi {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145922 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.145999 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146085 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146173 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146265 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146348 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146464 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146552 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146641 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146729 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146823 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146906 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.146996 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147078 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147302 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147549 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147664 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147854 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.147956 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148155 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148254 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148463 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148614 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148744 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.148879 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149015 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149149 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149342 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149484 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149664 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.149852 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150158 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150305 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150482 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150722 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150856 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.150994 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151129 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151265 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-30-iscsi {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151394 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151538 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151667 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.151960 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152127 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152267 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152395 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152395 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152739 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152869 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.152993 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153119 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153274 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153423 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153562 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153690 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153822 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.153955 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154090 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154341 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154547 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154726 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154858 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.154974 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155089 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155227 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155365 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155365 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155716 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.155716 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156032 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156193 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156322 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156322 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156586 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156714 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156851 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.156979 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157105 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157253 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157527 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157670 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157807 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.157935 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158068 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158195 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158321 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158456 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158587 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158726 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158863 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.158990 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.159126 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.159264 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.159431 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.159563 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.159877 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160013 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160013 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160263 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160396 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160532 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160532 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160770 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.160906 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161043 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161180 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161386 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161386 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161638 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161774 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.161902 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162029 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162155 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162292 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162428 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162565 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162700 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162827 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.162953 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163080 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163220 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163403 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163544 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163678 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163805 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.163980 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164122 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164284 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164414 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164601 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164732 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.164902 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165044 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165206 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165421 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165566 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165703 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165844 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.165974 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166178 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166314 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166441 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166566 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166699 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166835 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.166993 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167123 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167289 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167419 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167715 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167845 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.167972 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168099 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168224 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168358 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168495 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168623 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168739 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168863 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.168988 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169114 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169274 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169404 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169564 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169696 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169865 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.169995 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170165 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170298 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170464 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170595 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170763 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.170901 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171068 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171206 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171365 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171502 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171665 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171808 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.171965 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172095 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172263 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172391 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172565 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172705 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.172875 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173004 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173173 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173349 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173498 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173643 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173796 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.173936 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174077 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174204 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174393 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174536 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174691 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.174821 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.175499 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.175639 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.175924 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.176063 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.176241 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.176430 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.176560 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.176741 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.176880 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.177059 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.177197 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.177388 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.177534 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.177809 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.177946 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.178075 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.178202 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.178327 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.178460 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.178587 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.178723 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.178852 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.179009 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.179140 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.179326 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.179457 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.179642 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.179773 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.179968 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.180099 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.180280 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.180419 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.180580 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.180712 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.180877 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.181009 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.181180 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.181351 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.181502 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.181633 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.181814 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.181946 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.182128 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.182268 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.182429 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.182560 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.182727 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.182864 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.183027 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.183171 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.183336 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:38:06.183467 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.183667 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.183798 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.183994 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184139 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184315 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184445 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184626 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184756 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.184937 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185084 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185279 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185414 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185599 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185730 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.185906 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186039 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186215 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186355 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186527 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186691 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186838 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.186967 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.187124 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.187256 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.187431 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.187562 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.187900 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188037 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188172 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188304 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188431 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188557 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188682 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188808 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.188935 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189060 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189259 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189571 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189710 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.189885 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.190016 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.190208 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.190352 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.190524 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.190681 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.191462 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.191596 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.191851 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.191991 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192167 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192296 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192476 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192616 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192800 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.192945 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193114 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193276 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193448 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193592 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193757 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.193903 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194066 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194197 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194379 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194509 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194692 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.194826 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195004 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195142 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195308 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195439 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195614 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195746 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.195924 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196063 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196229 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196360 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196535 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196667 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196842 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.196981 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.197147 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.197328 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.197497 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.197629 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.197892 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198035 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198163 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198299 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198434 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198561 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198688 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198815 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.198991 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199130 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199296 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199427 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199596 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199727 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.199896 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200036 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200195 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200334 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200500 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200640 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200799 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.200945 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201115 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201266 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201468 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201600 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201773 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.201915 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202098 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202229 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202399 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202529 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202707 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.202838 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203012 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203142 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203314 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203451 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203615 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203745 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.203914 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204046 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204219 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204356 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204519 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204657 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204824 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.204957 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205127 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205296 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205452 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205589 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205753 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.205877 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206060 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206204 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206420 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206557 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206752 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.206936 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207068 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207205 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207341 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207476 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207646 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.207777 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208050 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208198 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208334 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208470 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208598 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208725 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208866 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.208995 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209166 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209366 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209519 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209663 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209805 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.209934 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210129 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210261 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210436 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210565 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210746 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.210884 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211046 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211177 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211359 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211489 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211658 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211797 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.211958 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212089 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212256 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212402 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212559 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212690 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212856 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.212995 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213155 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213317 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213491 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213622 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213788 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.213920 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214085 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214226 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214400 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214532 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214701 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214842 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.214999 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215140 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215297 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215429 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215594 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215724 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.215931 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216074 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216231 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216362 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216538 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216676 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.216888 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217019 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217146 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217293 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217472 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217604 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217790 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.217924 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218188 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218321 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218462 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218590 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218727 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218856 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.218983 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219117 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219268 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219410 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219586 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219727 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.219893 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220033 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220206 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220357 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220513 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220653 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220822 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.220953 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221130 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221302 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221467 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221605 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221765 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.221925 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222103 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222308 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222440 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222567 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222694 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.222911 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223043 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223224 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223357 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223569 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223700 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223827 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.223964 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224130 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224262 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224435 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224566 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224740 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.224885 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225044 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225177 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225376 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225508 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225687 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225836 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.225990 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226113 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226303 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226436 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226608 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226748 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.226924 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227056 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227226 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227363 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227664 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227827 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.227957 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228144 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228444 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228584 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228746 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.228879 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229053 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229185 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229385 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229541 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229696 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.229841 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230002 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230134 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230309 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230442 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230618 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230750 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.230920 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231065 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231228 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231359 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231536 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231674 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231844 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.231983 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232149 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232289 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232457 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232590 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232756 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.232897 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233065 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233205 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233399 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233530 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233698 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233840 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.233996 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234127 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234301 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234433 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234612 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234756 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.234915 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235045 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235222 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235352 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235526 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235658 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235822 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.235952 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.236121 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.236252 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.236435 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.236702 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.236833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.237025 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.237155 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.237334 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.237978 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.238159 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.238443 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.238618 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.238748 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.238876 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239013 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239142 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239270 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239397 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239522 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239682 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239815 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.239987 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240132 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240296 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240426 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240601 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240743 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.240907 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241039 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241239 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241373 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241558 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241705 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.241864 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242002 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242169 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242307 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242475 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242615 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242775 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.242905 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243077 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243208 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243385 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243594 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243714 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243838 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.243972 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244107 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244274 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244407 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244576 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244707 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.244876 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245014 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245188 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245353 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245521 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245779 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.245912 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246114 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246263 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246414 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246544 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246739 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.246875 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247048 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247186 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247362 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247492 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247691 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.247821 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.248018 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.248150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.248321 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.248845 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.248989 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249128 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249275 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249427 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249558 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249686 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249813 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.249940 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250090 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250232 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250399 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250539 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250700 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250831 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.250999 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251145 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251307 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251445 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251613 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251750 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.251913 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252054 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252214 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252355 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252514 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252644 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252822 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.252965 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.253124 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.253817 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254029 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254162 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254341 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254475 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254648 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254780 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.254950 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255088 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255251 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255383 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255551 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255690 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255850 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.255980 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256160 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256292 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256463 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256594 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256781 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.256912 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257085 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257270 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257402 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257531 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257705 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.257858 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258016 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258155 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258330 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258469 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258628 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.258905 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259040 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259168 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259302 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259430 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259565 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259702 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259831 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.259958 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260084 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260211 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260371 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260504 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260676 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260807 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.260981 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261119 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261310 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261445 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261618 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261749 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.261918 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262060 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262217 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262348 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262517 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262646 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262821 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.262951 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263120 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263252 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263419 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263550 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263717 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.263856 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264017 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264147 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264315 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264446 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264612 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264755 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.264907 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265036 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265219 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265387 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265526 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265664 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265828 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.265968 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266126 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266257 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266426 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266565 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266728 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.266859 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267024 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267157 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267340 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267480 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267646 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267777 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.267946 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268078 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268244 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268384 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268547 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268679 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.268964 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269100 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269287 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269421 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269593 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269723 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.269909 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270041 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270241 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270369 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270502 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270627 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270800 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.270931 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271100 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271236 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271399 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271527 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271703 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.271843 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272007 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272147 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272306 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272436 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272603 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272744 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.272901 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273030 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273200 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273393 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273530 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273668 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273824 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.273957 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274130 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274260 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274428 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274567 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274727 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.274858 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275026 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275156 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275332 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275462 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275640 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275770 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.275951 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276096 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276262 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276401 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276568 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276697 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.276880 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277008 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277186 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277345 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277515 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277646 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277827 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.277963 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278126 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278258 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278431 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278560 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278732 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.278870 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279127 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279258 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279385 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279511 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279638 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279775 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.279903 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280030 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280198 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280329 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280504 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280647 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280819 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.280952 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281135 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281317 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281486 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281637 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281767 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.281894 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282075 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282206 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282379 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282520 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282683 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282815 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.282986 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283125 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283289 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283421 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283593 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283732 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.283900 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284032 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284204 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284361 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284555 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284729 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.284860 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285057 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285241 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285375 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285682 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285815 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.285988 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286121 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286309 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286433 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286615 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286739 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.286936 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287077 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287242 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287380 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287543 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287682 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287850 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.287983 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.288148 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.288339 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.288567 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.288699 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.288875 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289008 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289310 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289444 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289573 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289708 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289837 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.289964 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290091 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290217 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290385 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290532 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290695 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290828 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.290994 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.291140 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.291390 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.291529 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.291700 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.291839 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292004 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292142 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292304 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292443 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292602 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292733 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.292900 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293032 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293206 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293357 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293549 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293682 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293849 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.293981 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294150 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294276 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294449 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294592 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294764 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.294905 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295063 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295205 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295378 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295511 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295757 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.295888 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296066 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296204 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296351 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296479 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296658 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296788 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.296979 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297110 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297310 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297443 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297605 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297737 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.297913 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298058 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298228 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298361 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298532 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298664 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298835 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.298976 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.299154 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.299450 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.299588 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.299715 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.299841 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.300515 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.300715 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.300850 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.300976 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301101 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301266 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301414 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301545 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301673 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301863 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.301995 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302173 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302311 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302479 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302610 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302783 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.302914 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303089 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303230 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303432 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303566 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303737 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.303874 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304059 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304199 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304379 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304507 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304680 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304810 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.304986 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305118 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305331 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305466 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305638 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305785 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.305955 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306093 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306258 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306565 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306706 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.306872 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307004 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307175 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307304 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307475 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307615 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307774 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.307905 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308075 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308212 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308377 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308515 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.308994 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309123 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309461 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309601 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309739 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309868 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.309996 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310132 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310270 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310398 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310526 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310653 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310809 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.310941 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311106 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311240 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311407 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311538 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311711 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.311851 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312040 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312171 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312343 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312474 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312671 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312814 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.312986 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313126 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313314 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313447 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313645 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313789 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.313954 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314086 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314269 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314407 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314583 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314731 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.314897 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.315029 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.315196 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.315326 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.315496 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.315657 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.316486 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.316619 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.316800 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.316937 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317138 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317289 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317419 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317551 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317712 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.317844 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318012 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318154 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318312 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318445 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318614 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.318858 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319004 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319186 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319320 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319584 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319718 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319846 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.319983 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320120 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320248 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320376 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320503 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320670 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320805 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.320993 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321125 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321319 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321453 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321631 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321763 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.321942 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322075 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322264 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322401 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322584 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322715 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.322890 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323034 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323210 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323351 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323522 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323654 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323834 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.323965 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324146 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324356 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324541 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324672 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324800 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.324928 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325060 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325198 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325356 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325484 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325662 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.325974 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326108 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326285 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326416 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326597 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326731 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.326920 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327107 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327247 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327431 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327563 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327741 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.327882 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328050 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328194 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328358 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328497 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328667 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328801 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.328975 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329115 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329294 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329425 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329704 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329841 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.329969 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330096 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330223 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330350 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330487 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330614 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.330801 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331105 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331286 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331496 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331632 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331780 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.331975 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332111 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332239 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332385 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332523 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332690 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.332830 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333030 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333160 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333363 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333497 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333668 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333800 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.333971 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334115 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334281 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334411 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334589 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334711 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.334893 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335036 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335198 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335335 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335507 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335639 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335810 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.335949 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336115 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336246 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336421 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336560 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336730 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.336949 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337082 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337471 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337642 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337785 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.337968 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338108 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338287 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338417 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338598 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338739 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.338902 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339034 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339226 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339413 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339545 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339819 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.339954 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340082 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340209 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340346 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340484 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340649 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340782 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.340961 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341101 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341298 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341445 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341619 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341749 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.341921 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342052 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342226 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342373 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342527 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342657 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342829 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.342969 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343130 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343272 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343436 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343566 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343739 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.343870 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344041 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344174 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344343 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344475 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344647 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344786 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.344949 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.345170 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.345333 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.345540 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.345674 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.345857 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346002 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346165 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346297 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346468 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.346777 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.347480 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.347619 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.347746 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.347910 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348069 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348211 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348348 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348478 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348613 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348796 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.348929 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.349105 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.349238 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.349434 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.349565 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.349878 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350034 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350175 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350306 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350440 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350569 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350704 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350833 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.350969 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351106 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351242 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351370 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351521 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351826 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.351964 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352133 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352274 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352435 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352567 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352742 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.352883 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353044 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353176 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353412 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353542 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353750 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.353883 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354011 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354146 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354274 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354401 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354538 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354656 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354816 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.354951 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355115 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355256 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355421 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355553 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355720 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.355851 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356027 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356167 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356370 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356502 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356689 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356820 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.356991 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357135 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357315 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357448 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357625 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357754 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.357931 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358063 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358238 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358368 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358546 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358677 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358855 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.358995 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.359189 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.359319 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.359503 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.359633 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.359819 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360079 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360222 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360351 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360479 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360646 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360791 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.360974 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361105 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361322 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361457 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361630 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361764 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.361936 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.362067 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.362238 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.362378 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363131 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363272 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363451 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363634 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363765 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.363959 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364101 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364283 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364423 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364606 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364737 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.364919 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365044 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365247 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365380 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365566 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365698 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.365875 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366007 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366180 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366311 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366487 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366619 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366792 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.366925 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367098 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367229 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367409 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367574 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367763 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.367895 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368070 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368202 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368377 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368519 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368687 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368817 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.368994 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369125 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369323 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369470 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369630 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369787 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.369917 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370180 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370325 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370464 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370594 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370723 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370851 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.370978 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371105 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371222 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371441 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371574 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371686 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.371865 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372009 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372180 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372320 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372496 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372637 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372812 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.372958 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.373119 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.373283 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.373717 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.373867 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374007 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374136 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374319 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374458 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374622 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374755 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.374929 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375061 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375229 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375360 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375536 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375667 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375837 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.375971 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376167 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376299 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376484 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376614 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376788 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.376921 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377091 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377261 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377423 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377569 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377741 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.377881 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378049 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378200 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378374 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378599 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378731 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.378970 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.379356 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.379356 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.379604 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.379742 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.379872 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380000 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380294 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380430 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380612 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380752 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.380881 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381016 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381158 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381331 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381476 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381606 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381734 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381861 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.381989 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382116 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382276 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382542 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382675 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382802 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.382930 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383135 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383267 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383395 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383531 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383660 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383797 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.383926 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384054 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384181 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384318 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384513 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384655 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384826 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.384958 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385208 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385386 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385527 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385666 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385795 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.385923 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386080 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386213 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386398 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386533 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386715 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.386845 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387027 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387158 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387336 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387471 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387650 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387780 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.387958 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388088 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388264 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388397 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388702 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.388878 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389009 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389183 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389336 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389511 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389656 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389834 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.389975 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.390158 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.390426 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.390559 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.390687 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.390815 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 04:38:06.390951 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.391090 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.391376 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.391689 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.392002 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.392328 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.392635 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.392941 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.393286 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.393580 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.394024 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.394599 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.394995 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.395328 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.395657 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.395968 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.396292 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.396616 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.396962 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.397296 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.397643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.397972 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.398283 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.398593 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.398897 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:38:06.399140 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 04:38:06.449465 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO dbcounter [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Registered counter for database nova_api Jun 07 04:38:06.457540 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO dbcounter [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Registered counter for database nova_api Jun 07 04:38:06.472437 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.478228 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_db.sqlalchemy.engines [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.480085 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writer thread running {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.484649 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writer thread running {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.538514 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.context [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6(cell1) {{(pid=110022) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 04:38:06.541713 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.context [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6(cell1) {{(pid=110023) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 04:38:06.542602 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:38:06.544143 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:38:06.544917 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:38:06.545759 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_concurrency.lockutils [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:38:06.546885 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:38:06.547311 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_concurrency.lockutils [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:38:06.548084 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_concurrency.lockutils [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:38:06.548826 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO dbcounter [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Registered counter for database nova_cell0 Jun 07 04:38:06.550094 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_concurrency.lockutils [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:38:06.552696 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO dbcounter [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Registered counter for database nova_cell0 Jun 07 04:38:06.554049 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO dbcounter [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Registered counter for database nova_cell1 Jun 07 04:38:06.556586 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO dbcounter [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Registered counter for database nova_cell1 Jun 07 04:38:06.561818 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.564948 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.566210 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_db.sqlalchemy.engines [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.568723 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writer thread running {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.568848 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_db.sqlalchemy.engines [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.573318 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writer thread running {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.709737 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writer thread running {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.712677 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writer thread running {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.719449 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO dbcounter [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Registered counter for database nova_cell0 Jun 07 04:38:06.723025 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO dbcounter [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Registered counter for database nova_cell0 Jun 07 04:38:06.727762 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.729616 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG oslo_db.sqlalchemy.engines [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:38:06.732351 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writer thread running {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:06.734283 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writer thread running {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:38:07.192226 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: WARNING keystonemiddleware.auth_token [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:38:07.195389 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: WARNING keystonemiddleware.auth_token [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:38:07.199447 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: WARNING keystonemiddleware.auth_token [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:38:07.202595 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: WARNING keystonemiddleware.auth_token [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:38:07.418581 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: WARNING keystonemiddleware.auth_token [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:38:07.424790 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: WARNING keystonemiddleware.auth_token [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:38:07.429747 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: WARNING keystonemiddleware.auth_token [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:38:07.430697 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ed1f719c0 pid: 110022 (default app) Jun 07 04:38:07.433855 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:38:07.435022 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002821 Jun 07 04:38:07.435414 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Tue Jun 7 04:38:07 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:38:07.435755 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: WARNING keystonemiddleware.auth_token [None req-6adeab5b-8edd-4626-afac-ac5b01bb1c93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:38:07.441053 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ed1f719c0 pid: 110023 (default app) Jun 07 04:39:26.209359 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:26.210378 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 07 04:39:26.210785 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:26.232309 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_api:SELECT=3 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:26.233868 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_cell0:SELECT=3 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:26.234955 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_cell1:SELECT=3 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:26.235949 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:26.681478 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-4265d65e-1fce-4859-9824-b43678d5d052 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:26.711144 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-4265d65e-1fce-4859-9824-b43678d5d052 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489839 Jun 07 04:39:26.712080 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Tue Jun 7 04:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:29.054054 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:29.055059 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-4ccf33a5-d3e9-4fbe-b3b1-d0fb58e287d3 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 07 04:39:29.055463 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:29.123259 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-3c9aae20-4f33-4ed2-8ec4-106bd6249de1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:29.144181 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:39:29.144181 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: warnings.warn(msg) Jun 07 04:39:29.174423 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-3c9aae20-4f33-4ed2-8ec4-106bd6249de1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112675 Jun 07 04:39:29.175520 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 04:39:29.404034 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-46df9442-cc84-42d6-ac2c-94c0b7de17d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:29.406570 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:39:29.406570 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:39:29.409556 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_api:SELECT=3 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:29.410417 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_cell1:SELECT=3 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:29.411585 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_cell0:SELECT=3 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:29.412328 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:39:29.477003 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-46df9442-cc84-42d6-ac2c-94c0b7de17d3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293281 Jun 07 04:39:29.477774 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Tue Jun 7 04:39:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:31.915486 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-3c9aae20-4f33-4ed2-8ec4-106bd6249de1 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:31.916663 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-3c9aae20-4f33-4ed2-8ec4-106bd6249de1 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jun 07 04:39:31.917340 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:32.026644 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-f5049909-78f3-4b6f-a34b-fd95acdf0701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds512M", "disk": 5, "id": "d1"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:32.044453 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:39:32.044453 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:39:32.067744 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-f5049909-78f3-4b6f-a34b-fd95acdf0701 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144578 Jun 07 04:39:32.068307 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:32.079952 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-96e4a9f8-a962-40b1-bb12-faed368ee201 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:32.082376 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:39:32.082376 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: warnings.warn(msg) Jun 07 04:39:32.112736 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-96e4a9f8-a962-40b1-bb12-faed368ee201 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036302 Jun 07 04:39:32.113355 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Tue Jun 7 04:39:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:34.488372 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-f5049909-78f3-4b6f-a34b-fd95acdf0701 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:34.489640 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-f5049909-78f3-4b6f-a34b-fd95acdf0701 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jun 07 04:39:34.490044 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:34.551897 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-b2e814be-903b-4561-8d2e-115d224a7168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 10, "name": "ds1G", "id": "d2", "ram": 1024}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:34.576988 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-b2e814be-903b-4561-8d2e-115d224a7168 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081052 Jun 07 04:39:34.584969 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:34.591775 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-4da845d1-b943-40e7-be5e-440a448d20ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:34.623114 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-4da845d1-b943-40e7-be5e-440a448d20ba admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035245 Jun 07 04:39:34.623939 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Tue Jun 7 04:39:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:36.955876 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-b2e814be-903b-4561-8d2e-115d224a7168 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:36.956816 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-b2e814be-903b-4561-8d2e-115d224a7168 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 07 04:39:36.957218 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:37.017130 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-27c44953-3fab-4e95-8252-c3419a6d6b4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:37.035462 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-27c44953-3fab-4e95-8252-c3419a6d6b4d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072621 Jun 07 04:39:37.036160 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 04:39:37.048045 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-52ef2440-8d92-479c-b036-361a19e38aef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:37.074387 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-52ef2440-8d92-479c-b036-361a19e38aef admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030002 Jun 07 04:39:37.074984 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Tue Jun 7 04:39:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:39:39.553940 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-27c44953-3fab-4e95-8252-c3419a6d6b4d admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:39.554949 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-27c44953-3fab-4e95-8252-c3419a6d6b4d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 07 04:39:39.555356 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:39.621172 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:39.639857 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078755 Jun 07 04:39:39.640644 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 04:39:39.652189 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-07ca24f4-c0f4-436e-85f0-c9d7d3e3453e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:39.678160 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-07ca24f4-c0f4-436e-85f0-c9d7d3e3453e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029413 Jun 07 04:39:39.679905 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Tue Jun 7 04:39:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:39:42.004670 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:42.005781 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jun 07 04:39:42.006189 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:42.075263 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-28b56f44-e64e-49d0-871e-a30dc45345d1 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:42.100445 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-28b56f44-e64e-49d0-871e-a30dc45345d1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087550 Jun 07 04:39:42.101289 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Tue Jun 7 04:39:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:39:44.630425 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:44.631453 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-a912d632-9adf-4179-b29d-254d86a4c6e5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 07 04:39:44.631847 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:44.695963 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-63bd756f-1486-45f8-a511-0cb8fe4440f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:44.715481 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-63bd756f-1486-45f8-a511-0cb8fe4440f0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077528 Jun 07 04:39:44.716118 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:44.728814 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-ce6bffd0-f115-4f1f-8473-2106e6b0929b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:44.753429 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-ce6bffd0-f115-4f1f-8473-2106e6b0929b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028203 Jun 07 04:39:44.754015 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Tue Jun 7 04:39:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:47.071819 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-63bd756f-1486-45f8-a511-0cb8fe4440f0 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:47.073140 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-63bd756f-1486-45f8-a511-0cb8fe4440f0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jun 07 04:39:47.073655 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:47.137083 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-52640e9c-1179-46d6-a301-292cbca824cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:47.154980 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-52640e9c-1179-46d6-a301-292cbca824cf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073785 Jun 07 04:39:47.155541 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 04:39:47.170615 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-905a0b83-b32a-4f43-8876-91ed60c8b9ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:47.197955 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-905a0b83-b32a-4f43-8876-91ed60c8b9ab admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031922 Jun 07 04:39:47.198649 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Tue Jun 7 04:39:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:49.946695 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-52640e9c-1179-46d6-a301-292cbca824cf admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:49.947631 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-52640e9c-1179-46d6-a301-292cbca824cf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 07 04:39:49.948212 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:50.009871 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-8e5f9f59-16e1-45c0-aa6e-419ff7c95637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:50.028847 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-8e5f9f59-16e1-45c0-aa6e-419ff7c95637 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075055 Jun 07 04:39:50.029627 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:50.042137 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-f8278fc2-f5cc-4731-96ff-bffb9913b466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:50.065029 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-f8278fc2-f5cc-4731-96ff-bffb9913b466 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026758 Jun 07 04:39:50.065676 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Tue Jun 7 04:39:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:52.370960 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-8e5f9f59-16e1-45c0-aa6e-419ff7c95637 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:52.371964 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-8e5f9f59-16e1-45c0-aa6e-419ff7c95637 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 07 04:39:52.372362 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:52.435103 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-4d31d38a-b1d5-4655-a63e-699616fcaf0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:52.452756 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-4d31d38a-b1d5-4655-a63e-699616fcaf0a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074270 Jun 07 04:39:52.453423 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:52.465533 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-07c877dd-6456-442a-aa0e-ecb08645fd1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:52.493431 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-07c877dd-6456-442a-aa0e-ecb08645fd1d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031297 Jun 07 04:39:52.494728 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Tue Jun 7 04:39:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:39:54.967574 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-4d31d38a-b1d5-4655-a63e-699616fcaf0a admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:39:54.968588 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-4d31d38a-b1d5-4655-a63e-699616fcaf0a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 07 04:39:54.968997 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:39:55.036412 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:55.058557 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083075 Jun 07 04:39:55.059273 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Tue Jun 7 04:39:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:39:55.072102 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-1c2b5f11-2606-43bb-ae4c-20813592457e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:39:55.101613 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-1c2b5f11-2606-43bb-ae4c-20813592457e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033150 Jun 07 04:39:55.102909 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Tue Jun 7 04:39:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:40:19.181551 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:19.182554 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 07 04:40:19.182944 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:19.194317 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:40:19.242306 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-e4ee2993-c88c-4a14-b3b4-5cb332a365c9 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:19.260794 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-e4ee2993-c88c-4a14-b3b4-5cb332a365c9 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070978 Jun 07 04:40:19.261342 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Tue Jun 7 04:40:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:20.269472 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:20.270469 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-5b31f64b-1be4-4bc0-8eb3-dae43d34a65a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 07 04:40:20.270860 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:20.488927 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-758ca17b-7cfa-48cd-87e8-4126b0a6feea admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:20.494597 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.wsgi [None req-758ca17b-7cfa-48cd-87e8-4126b0a6feea admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-758ca17b-7cfa-48cd-87e8-4126b0a6feea admin admin] Request method failure captured: Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept: application/json Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept-Encoding: gzip, deflate Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Connection: keep-alive Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Content-Length: 0 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Host: 10.222.0.40 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-System-Scope: None Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: User-Agent: python-novaclient Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Auth-Token: gAAAAABinta0b1eN0nTonDUamjWuiZTRqBjf_8_-lrqmlBVXTHdl0qdiR9kCvi9iIVetqMeZM2XxOlYiWWtvPEDJCfOsyHLiBfWDGKTlQtXGt7xZ5TKOKdeuwGTIW9p0JX80CHeOkxeTBpQQvRUa3vV2Y2U5GwvlhlMamO_hdxMICRJoLDukV2A Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Id: None Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Name: None Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Identity-Status: Confirmed Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Is-Admin-Project: True Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Id: default Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Name: Default Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Name: admin Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Role: member,admin,reader Jun 07 04:40:20.498071 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Roles: member,admin,reader Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant: admin Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Name: admin Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User: admin Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Id: default Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Name: Default Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Name: admin Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: method: > Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: exception: Flavor 42 could not be found. Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: action_args: {'id': '42'} Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:20.499830 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:20.505833 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.507518 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-758ca17b-7cfa-48cd-87e8-4126b0a6feea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:20.508852 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-758ca17b-7cfa-48cd-87e8-4126b0a6feea admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062880 Jun 07 04:40:20.508852 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Jun 7 04:40:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 04:40:20.515346 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-3ba6a324-df19-4815-a8dc-f2774db492a5 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:20.519017 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:40:20.539170 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-3ba6a324-df19-4815-a8dc-f2774db492a5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030162 Jun 07 04:40:20.539720 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:20.550089 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-675052d6-ddff-4562-af35-ba14579b1e2d admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:20.572044 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-675052d6-ddff-4562-af35-ba14579b1e2d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026133 Jun 07 04:40:20.572582 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:20.583345 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-d8a6cf84-984d-4959-90c2-9924377dc0e8 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:20.590258 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.wsgi [None req-d8a6cf84-984d-4959-90c2-9924377dc0e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-d8a6cf84-984d-4959-90c2-9924377dc0e8 admin admin] Request method failure captured: Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept: application/json Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept-Encoding: gzip, deflate Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Connection: keep-alive Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Content-Length: 0 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Host: 10.222.0.40 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-System-Scope: None Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: User-Agent: python-novaclient Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Auth-Token: gAAAAABinta0b1eN0nTonDUamjWuiZTRqBjf_8_-lrqmlBVXTHdl0qdiR9kCvi9iIVetqMeZM2XxOlYiWWtvPEDJCfOsyHLiBfWDGKTlQtXGt7xZ5TKOKdeuwGTIW9p0JX80CHeOkxeTBpQQvRUa3vV2Y2U5GwvlhlMamO_hdxMICRJoLDukV2A Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Id: None Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Name: None Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Identity-Status: Confirmed Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Is-Admin-Project: True Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Id: default Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Name: Default Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Name: admin Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Role: member,admin,reader Jun 07 04:40:20.593531 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Roles: member,admin,reader Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant: admin Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Name: admin Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User: admin Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Id: default Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Name: Default Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Name: admin Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: method: > Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: exception: Flavor 42 could not be found. Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: action_args: {'id': '42'} Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:20.595794 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:20.596771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:20.598152 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-d8a6cf84-984d-4959-90c2-9924377dc0e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:20.599427 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-d8a6cf84-984d-4959-90c2-9924377dc0e8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016730 Jun 07 04:40:20.599427 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Jun 7 04:40:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 04:40:21.474606 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-675052d6-ddff-4562-af35-ba14579b1e2d admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:21.475630 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-675052d6-ddff-4562-af35-ba14579b1e2d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 07 04:40:21.476019 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:21.664994 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-67599997-de4d-4c5a-b955-a3130458cafb admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:21.670889 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.wsgi [None req-67599997-de4d-4c5a-b955-a3130458cafb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-67599997-de4d-4c5a-b955-a3130458cafb admin admin] Request method failure captured: Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept: application/json Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept-Encoding: gzip, deflate Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Connection: keep-alive Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Content-Length: 0 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Host: 10.222.0.40 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-System-Scope: None Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: User-Agent: python-novaclient Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Auth-Token: gAAAAABinta1WnJuRz4pp9Q7OXfyA8N3GM_ZqiRfDlUQpwBvpCUDeQcPtHquCBIyrSa2kcd16TKjNm-AqsbAjr1vBEZZDRuEQLBjNigACLJ3WYlT_hyAxuXO1lOAGyhRoo-jev5Z6xIoNzvDzJpiL5HEcHFSXNlzhwLFKpDieKt8H8dkFzjJTDs Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Id: None Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Name: None Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Identity-Status: Confirmed Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Is-Admin-Project: True Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Id: default Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Name: Default Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Name: admin Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Role: member,admin,reader Jun 07 04:40:21.672388 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Roles: member,admin,reader Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant: admin Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Name: admin Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User: admin Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Id: default Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Name: Default Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Name: admin Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: method: > Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: exception: Flavor 84 could not be found. Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: action_args: {'id': '84'} Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:21.674218 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:21.675150 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.676498 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-67599997-de4d-4c5a-b955-a3130458cafb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:21.677810 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-67599997-de4d-4c5a-b955-a3130458cafb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060891 Jun 07 04:40:21.677810 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Jun 7 04:40:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 04:40:21.683956 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5ecc7aa3-0ace-48c1-8dda-07b8ee2d8ee6 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:21.698332 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5ecc7aa3-0ace-48c1-8dda-07b8ee2d8ee6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018044 Jun 07 04:40:21.698880 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:21.709408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-80bf82c6-17dd-4057-acb0-608f87b65782 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:21.723462 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-80bf82c6-17dd-4057-acb0-608f87b65782 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 Jun 07 04:40:21.723975 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:21.733115 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-626edf69-0541-4d7b-bf19-05f14b7a27b3 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:21.739161 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.wsgi [None req-626edf69-0541-4d7b-bf19-05f14b7a27b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-626edf69-0541-4d7b-bf19-05f14b7a27b3 admin admin] Request method failure captured: Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept: application/json Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept-Encoding: gzip, deflate Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Connection: keep-alive Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Content-Length: 0 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Host: 10.222.0.40 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-System-Scope: None Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: User-Agent: python-novaclient Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Auth-Token: gAAAAABinta1WnJuRz4pp9Q7OXfyA8N3GM_ZqiRfDlUQpwBvpCUDeQcPtHquCBIyrSa2kcd16TKjNm-AqsbAjr1vBEZZDRuEQLBjNigACLJ3WYlT_hyAxuXO1lOAGyhRoo-jev5Z6xIoNzvDzJpiL5HEcHFSXNlzhwLFKpDieKt8H8dkFzjJTDs Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Id: None Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Name: None Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Identity-Status: Confirmed Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Is-Admin-Project: True Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Id: default Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Name: Default Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Name: admin Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Role: member,admin,reader Jun 07 04:40:21.740643 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Roles: member,admin,reader Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant: admin Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Name: admin Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User: admin Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Id: default Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Name: Default Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Name: admin Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: method: > Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: exception: Flavor 84 could not be found. Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: action_args: {'id': '84'} Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:21.742182 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:21.743255 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:21.744570 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-626edf69-0541-4d7b-bf19-05f14b7a27b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:21.745839 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-626edf69-0541-4d7b-bf19-05f14b7a27b3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012530 Jun 07 04:40:21.745839 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Jun 7 04:40:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 04:40:22.606460 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-80bf82c6-17dd-4057-acb0-608f87b65782 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:22.607540 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-80bf82c6-17dd-4057-acb0-608f87b65782 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 07 04:40:22.608031 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:22.799257 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-c037742e-debd-4bbf-b0e7-b53b028d6e38 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:22.805193 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.wsgi [None req-c037742e-debd-4bbf-b0e7-b53b028d6e38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-c037742e-debd-4bbf-b0e7-b53b028d6e38 admin admin] Request method failure captured: Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept: application/json Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Accept-Encoding: gzip, deflate Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Connection: keep-alive Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Content-Length: 0 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Host: 10.222.0.40 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Openstack-System-Scope: None Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: User-Agent: python-novaclient Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Auth-Token: gAAAAABinta2-9QoEGjaYCZbyfaRIswN-HtNrwhE7_6q17kRaSE2nWZtULxrIWrOZfyCSqG-Wn33iibpnuqkwxX4wmXM3vvTG7erl1a52rpUaK9xixggQRZizgr8oN8g0KGBuwmp7b5c7sJLSEmVzTGQmyYW9EZsWePuVWWuDmoUfmytV4YACs8 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Id: None Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Domain-Name: None Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Identity-Status: Confirmed Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Is-Admin-Project: True Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Id: default Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Domain-Name: Default Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Project-Name: admin Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Role: member,admin,reader Jun 07 04:40:22.806710 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Roles: member,admin,reader Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant: admin Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-Tenant-Name: admin Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User: admin Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Id: default Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Domain-Name: Default Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: X-User-Name: admin Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: method: > Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: exception: Flavor 451 could not be found. Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: action_args: {'id': '451'} Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:22.808406 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:22.809600 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.811056 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-c037742e-debd-4bbf-b0e7-b53b028d6e38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:22.812395 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-c037742e-debd-4bbf-b0e7-b53b028d6e38 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061960 Jun 07 04:40:22.812395 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:40:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 04:40:22.818013 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-4d1dfc4a-85ae-41ec-b905-235510493c4a admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:22.832163 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-4d1dfc4a-85ae-41ec-b905-235510493c4a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017970 Jun 07 04:40:22.832680 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:22.842011 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:22.856273 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017779 Jun 07 04:40:22.856789 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Jun 7 04:40:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:40:22.865936 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-e36a7cf2-0de5-43b2-8a85-d96ac2c0d592 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:22.871215 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.wsgi [None req-e36a7cf2-0de5-43b2-8a85-d96ac2c0d592 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-e36a7cf2-0de5-43b2-8a85-d96ac2c0d592 admin admin] Request method failure captured: Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept: application/json Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Accept-Encoding: gzip, deflate Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Connection: keep-alive Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Content-Length: 0 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Host: 10.222.0.40 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-Api-Version: compute 2.90 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Openstack-System-Scope: None Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: User-Agent: python-novaclient Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Auth-Token: gAAAAABinta2-9QoEGjaYCZbyfaRIswN-HtNrwhE7_6q17kRaSE2nWZtULxrIWrOZfyCSqG-Wn33iibpnuqkwxX4wmXM3vvTG7erl1a52rpUaK9xixggQRZizgr8oN8g0KGBuwmp7b5c7sJLSEmVzTGQmyYW9EZsWePuVWWuDmoUfmytV4YACs8 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Id: None Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Domain-Name: None Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Identity-Status: Confirmed Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Is-Admin-Project: True Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Id: default Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Domain-Name: Default Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Project-Name: admin Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Role: member,admin,reader Jun 07 04:40:22.872691 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Roles: member,admin,reader Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b83fd16caa4f36a3463c41fce96911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b83fd16caa4f36a3463c41fce96911"}]}] Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant: admin Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Id: 49b83fd16caa4f36a3463c41fce96911 Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-Tenant-Name: admin Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User: admin Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Id: default Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Domain-Name: Default Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Id: f39a03d64fb64df388215f4587e682c2 Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: X-User-Name: admin Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: method: > Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: exception: Flavor 451 could not be found. Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: action_args: {'id': '451'} Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:40:22.874323 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:22.875408 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: ERROR nova.api.openstack.wsgi Jun 07 04:40:22.877930 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-e36a7cf2-0de5-43b2-8a85-d96ac2c0d592 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:40:22.879265 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-e36a7cf2-0de5-43b2-8a85-d96ac2c0d592 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011634 Jun 07 04:40:22.879265 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:40:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 04:40:23.726467 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:23.727473 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 07 04:40:23.727873 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:23.917069 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-69fdba3e-94d9-4827-825e-8ad5bab7354c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:40:23.934237 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-69fdba3e-94d9-4827-825e-8ad5bab7354c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067796 Jun 07 04:40:23.934779 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Jun 7 04:40:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:40:24.803526 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:24.804638 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 07 04:40:24.805041 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:24.993895 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-9f185471-6911-4e92-8be2-e122e4ae45c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:40:25.011379 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-9f185471-6911-4e92-8be2-e122e4ae45c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068789 Jun 07 04:40:25.011920 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Jun 7 04:40:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:40:25.871922 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:25.872924 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 07 04:40:25.873346 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:26.061823 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-8dbeeede-0453-4249-8902-a719db8f60c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:40:26.082955 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-8dbeeede-0453-4249-8902-a719db8f60c0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073632 Jun 07 04:40:26.083515 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Jun 7 04:40:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:40:26.947631 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:26.948624 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 07 04:40:26.949021 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:27.136922 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-0846baf3-d958-4a0c-844c-98b400194d4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:40:27.154937 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-0846baf3-d958-4a0c-844c-98b400194d4f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069748 Jun 07 04:40:27.155470 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Jun 7 04:40:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:40:28.019883 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:28.020909 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 07 04:40:28.021325 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:40:28.208410 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-5a92fea2-aa68-4bc6-ae3d-e4ea65036c46 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:40:28.227883 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-5a92fea2-aa68-4bc6-ae3d-e4ea65036c46 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071450 Jun 07 04:40:28.228411 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Jun 7 04:40:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:41:29.843982 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:29.845016 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-5f6f661c-b811-477c-bcbb-ac9ef63d85cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 07 04:41:29.845455 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Tue Jun 7 04:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:41:29.852973 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:41:29.905642 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-92b85976-8fd5-48a2-b3a7-f314049e2dda admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:29.924707 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-92b85976-8fd5-48a2-b3a7-f314049e2dda admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073286 Jun 07 04:41:29.925260 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Tue Jun 7 04:41:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:41:29.946370 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG dbcounter [-] [110023] Writing DB stats nova_api:SELECT=14 {{(pid=110023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:41:29.950488 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-8798c092-99b3-4fda-821b-ab100d0c66ab admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:29.958699 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-8798c092-99b3-4fda-821b-ab100d0c66ab admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013802 Jun 07 04:41:29.959219 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Tue Jun 7 04:41:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:41:29.970504 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-a6d1241a-c252-4044-a2ef-5eb349bf99ac admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:29.978360 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-a6d1241a-c252-4044-a2ef-5eb349bf99ac admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011488 Jun 07 04:41:29.978876 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Tue Jun 7 04:41:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:41:29.990228 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:29.997746 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010851 Jun 07 04:41:29.998259 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Tue Jun 7 04:41:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:41:30.011181 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-0090f446-5a37-4f2a-84d7-797b725fa181 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:41:30.019874 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-0090f446-5a37-4f2a-84d7-797b725fa181 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013169 Jun 07 04:41:30.020703 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Tue Jun 7 04:41:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:44:58.385576 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:44:58.386668 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 07 04:44:58.387062 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:44:58.543337 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_api:SELECT=6 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:44:58.665188 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:44:58.666373 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:44:58.666373 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:44:58.667577 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:44:58.668016 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:44:58.668802 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:44:58.669238 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:44:58.703983 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-26dfb0f6-ae30-4b25-b907-caea7d59db36 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.162418 Jun 07 04:44:58.704560 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:44:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:44:59.595970 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:44:59.596973 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 07 04:44:59.597392 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:44:59.793394 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:44:59.794629 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:44:59.794629 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:44:59.796440 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:44:59.796872 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:44:59.797787 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:44:59.798212 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:44:59.819383 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-e29415a8-6cd4-4430-a3d0-7b92b776711a admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079117 Jun 07 04:44:59.819872 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:44:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:45:11.137623 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:45:11.138626 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 07 04:45:11.139020 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:45:11.284394 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_cell0:SELECT=4 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:45:11.285113 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_cell1:SELECT=4 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:45:11.285742 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG dbcounter [-] [110022] Writing DB stats nova_api:SELECT=8 {{(pid=110022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:45:11.334024 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:45:11.335178 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:45:11.335178 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:45:11.336342 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:45:11.336771 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:45:11.337605 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:45:11.338056 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:45:11.364335 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-87deb530-982c-4e4f-b298-99cae6499ebd admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084779 Jun 07 04:45:11.364805 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:45:11 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:45:12.244885 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: DEBUG nova.api.openstack.wsgi [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] Calling method '>' {{(pid=110023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:45:12.245916 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: INFO nova.api.openstack.requestlog [None req-58a0e4ea-b0be-454f-8494-86311fe951b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 04:45:12.246310 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: [pid: 110023|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Jun 7 04:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:45:12.453782 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG nova.api.openstack.wsgi [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] Calling method '>' {{(pid=110022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:45:12.455049 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 04:45:12.455049 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: warnings.warn(msg) Jun 07 04:45:12.456314 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:45:12.456799 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:45:12.457786 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:45:12.458226 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: DEBUG oslo_concurrency.lockutils [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:45:12.481593 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: INFO nova.api.openstack.requestlog [None req-12f7dc6b-f888-4d06-be29-1f385fcb026e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090863 Jun 07 04:45:12.482146 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: [pid: 110022|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Jun 7 04:45:12 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:46:09.511496 dv-cinder-836996-30-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 04:46:09.512405 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: Tue Jun 7 04:46:09 2022 - graceful shutdown triggered... Jun 07 04:46:09.512910 dv-cinder-836996-30-iscsi devstack@n-api.service[110022]: Gracefully killing worker 1 (pid: 110022)... Jun 07 04:46:09.513412 dv-cinder-836996-30-iscsi devstack@n-api.service[110023]: Gracefully killing worker 2 (pid: 110023)... Jun 07 04:46:10.513350 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: worker 1 buried after 1 seconds Jun 07 04:46:10.513350 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: worker 2 buried after 1 seconds Jun 07 04:46:10.513350 dv-cinder-836996-30-iscsi devstack@n-api.service[110021]: goodbye to uWSGI. Jun 07 04:46:10.515649 dv-cinder-836996-30-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 04:46:10.516214 dv-cinder-836996-30-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 04:46:10.519086 dv-cinder-836996-30-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 04:46:10.531881 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 04:46:10 2022] *** Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: nodename: dv-cinder-836996-30-iscsi Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: machine: x86_64 Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: clock source: unix Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: pcre jit disabled Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: detected number of CPU cores: 4 Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: current working directory: / Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: detected binary path: /usr/bin/uwsgi-core Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: your processes number limit is 47680 Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: your memory page size is 4096 bytes Jun 07 04:46:10.554775 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: detected max file descriptor number: 2048 Jun 07 04:46:10.555831 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: lock engine: pthread robust mutexes Jun 07 04:46:10.555831 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: thunder lock: enabled Jun 07 04:46:10.555831 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 04:46:10.555831 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 04:46:10.602513 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: Python main interpreter initialized at 0x5596d586a9c0 Jun 07 04:46:10.602513 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: python threads support enabled Jun 07 04:46:10.602513 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: your server socket listen backlog is limited to 100 connections Jun 07 04:46:10.602513 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: your mercy for graceful operations on workers is 90 seconds Jun 07 04:46:10.602928 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 04:46:10.602928 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: *** Operational MODE: preforking *** Jun 07 04:46:10.603201 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: *** uWSGI is running in multiple interpreter mode *** Jun 07 04:46:10.603201 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: spawned uWSGI master process (pid: 124400) Jun 07 04:46:10.603405 dv-cinder-836996-30-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 04:46:10.604095 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: spawned uWSGI worker 1 (pid: 124421, cores: 1) Jun 07 04:46:10.605286 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: spawned uWSGI worker 2 (pid: 124422, cores: 1) Jun 07 04:46:10.605286 dv-cinder-836996-30-iscsi devstack@n-api.service[124400]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 04:46:11.853615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 04:46:11.855662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 04:46:12.689968 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:46:12.689968 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: from cryptography.utils import int_from_bytes Jun 07 04:46:12.690305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:46:12.690305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: from cryptography.utils import int_from_bytes Jun 07 04:46:12.690490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:46:12.690490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: from cryptography.utils import int_from_bytes Jun 07 04:46:12.690708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 04:46:12.690708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: from cryptography.utils import int_from_bytes Jun 07 04:46:15.103704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 04:46:15.104254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 04:46:15.104367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 04:46:15.104367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 04:46:15.104792 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 04:46:15.104879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 04:46:15.104960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 04:46:15.105078 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 04:46:15.105274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 04:46:15.105496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 04:46:15.105608 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.105813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.105909 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106242 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106550 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106786 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.106890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.107097 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.107223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.107449 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.107682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.107805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108028 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.108955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-30-iscsi {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109636 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-30-iscsi {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.109949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.110061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.110265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.110364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.110595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.110907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111548 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.111856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.112998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.113126 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.113340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.113535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.113735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.113933 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.114135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.114337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.114536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.114729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.114925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.115122 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.115323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.115508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.115698 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.115899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.116095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.116293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-30-iscsi {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.116477 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-30-iscsi {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.116682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.116866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.117076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.117289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.117490 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.117685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.117878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118488 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118792 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.118924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119233 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.119936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.120082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.120213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.120370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.120508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.120654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.121583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.121811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.121948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.122086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.122237 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.122376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.122523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.122665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.123315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.123452 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.123594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.123733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.123937 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124071 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124349 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124609 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.124938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.125982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.126502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.126642 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.126773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.126773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127164 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127721 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.127991 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128817 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.128954 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129084 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129385 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.129929 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130712 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.130988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.131118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.131263 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.131477 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.131477 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.131818 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.132973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.133972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.134909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135041 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135169 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135443 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.135976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.136939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137077 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137675 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.137955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.138084 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.138221 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.138350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139280 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.139948 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140157 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140848 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.140981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141410 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.141976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142610 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.142886 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143418 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143693 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.143963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144226 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144365 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.144899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145378 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.145988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146128 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146292 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146426 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.146883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.147938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148105 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148417 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.148870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149037 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.149821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.150009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 04:46:15.150151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.150354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.150501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.150669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.150810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151706 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.151858 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152681 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.152949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153277 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153683 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153820 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.153957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.154194 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.154337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.154520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.154842 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.154972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155177 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155820 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.155955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.156914 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157100 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157443 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157577 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.157892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158107 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.158900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159080 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159224 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159540 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.159844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160027 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160482 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.160980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161121 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161466 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161627 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.161989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162199 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162333 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162701 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162839 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.162979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163646 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163785 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.163922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164375 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.164824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165336 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165697 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.165966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166233 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.166965 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167130 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167275 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167456 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.167904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.168856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.169029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.169165 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.169366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.169513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.170970 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171101 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171378 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.171916 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.172904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173177 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173693 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.173966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174097 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174233 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174493 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.174901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.175974 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176373 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.176911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177188 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177834 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.177978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.178897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179084 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179194 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179699 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.179805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180424 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180639 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.180944 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181040 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181333 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.181991 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182227 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.182992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.183949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184274 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184799 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.184902 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.185110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.185219 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186339 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186659 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.186974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187082 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.187936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188249 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188351 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188673 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.188980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189384 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189563 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.189995 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190219 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190316 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190546 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190856 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.190955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.191892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192420 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.192832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.193813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194140 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.194973 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195156 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.195952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196359 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.196997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197212 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197341 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197644 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.197957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.198889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199413 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.199829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200447 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200654 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.200756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.201602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.201812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.201951 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.202952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203278 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203607 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.203957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204225 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204446 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.204854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205705 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.205802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206459 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206670 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.206989 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207097 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.207941 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208254 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208891 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.208993 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209544 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.209952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210796 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.210892 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211230 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211748 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.211863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.212832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.213008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.213115 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.213612 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.213713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.213950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214590 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214686 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.214916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215022 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215237 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.215900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216005 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216347 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216581 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.216899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217336 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.217943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.218853 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219070 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219168 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.219994 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220100 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220620 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.220927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.221993 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.222207 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.222309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.222513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.222621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.223950 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224084 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224228 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224421 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.224834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225711 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.225808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226124 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226735 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.226950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.227268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.227546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.227643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.227870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.227973 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228604 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.228908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229765 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.229864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230075 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230387 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230692 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.230787 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231614 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.231918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.232058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.232267 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.232489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.232680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.232821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233387 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233603 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233698 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.233912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.234947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235246 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.235872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236077 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236173 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236385 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.236796 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.237964 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238369 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.238986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.239915 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240423 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240525 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240729 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.240834 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.241972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242385 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242697 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.242991 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243856 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.243999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244179 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.244929 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245587 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.245902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246111 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246734 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.246830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.247053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.247149 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.247378 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.247512 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.247675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.248287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.248531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.248717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.248827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.249934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250446 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.250861 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.251070 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.251427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.251648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.251752 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.251959 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252272 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252368 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.252893 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253207 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253638 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253854 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.253958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.254897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.255976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.256933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257429 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257712 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.257891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258327 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258737 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.258938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.259872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260186 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260293 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260492 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260596 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.260903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261546 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261650 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.261969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262177 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.262895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.263936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264258 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264491 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.264968 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265479 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265807 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.265917 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266848 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.266954 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.267221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.267325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.267552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.267655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268630 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268722 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268817 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.268992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269463 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269576 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269784 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.269879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.270839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271141 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271684 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.271779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272010 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.272754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273136 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.273814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274124 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274436 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.274976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275267 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.275984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.276917 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.277912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278071 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.278798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.279547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.279655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.279890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280635 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.280952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281162 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.281930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.282869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283111 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283421 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.283852 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284182 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284414 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.284830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285082 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285709 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.285821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286640 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.286947 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287257 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287362 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287563 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.287867 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288173 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288479 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288784 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.288887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289534 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.289840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290156 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290459 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.290974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291076 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291281 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291684 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.291933 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292036 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292239 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292573 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.292992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293212 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293352 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293698 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293866 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.293971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.294184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.294279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.294500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.294596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.295464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.295601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.295702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.295932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.296906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297004 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297240 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297339 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.297876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.298117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.298265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.298444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.298543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.298769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299346 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299666 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.299984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300081 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300410 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.300934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301386 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301589 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.301904 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.302975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.303940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304149 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304562 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.304887 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305105 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305771 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.305887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306081 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.306818 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.307972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308071 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308699 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.308916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309018 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.309905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310014 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310229 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.310916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.311178 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.311291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.311578 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.311681 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.311909 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.312988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313380 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313538 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.313962 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314589 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.314908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315522 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315749 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.315907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316590 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.316945 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.317056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.317290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.317545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.317643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.317901 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318223 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318321 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.318987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.319922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.320850 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321055 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321385 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.321803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322108 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.322929 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323331 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323636 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323853 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.323949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.324870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325079 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325410 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.325815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.326120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.326231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.326439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.326710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.326807 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327140 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.327967 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.328941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329089 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329272 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329388 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.329901 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330215 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330635 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.330949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.331161 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.331258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.331513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.331727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.331833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.332072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.332352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.332457 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.332691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.332788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333015 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333377 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.333799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334003 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334422 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334728 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.334939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335042 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335251 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.335985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336192 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336290 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336607 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.336920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337577 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.337871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338226 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338712 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.338809 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339026 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339126 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.339994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340722 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.340940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.341037 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.341282 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.341408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.342118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.342292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.342418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.342718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.342854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343042 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343168 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.343818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344134 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.344868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.345857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346701 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.346863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.347157 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.347500 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.348872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.349881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.350978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351365 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351614 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351847 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.351963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.352878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353188 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353421 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.353828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354041 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354443 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354650 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.354955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355365 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.355966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.356180 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.356290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.356484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.356761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.356865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.357083 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.357273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.357974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358082 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358443 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358581 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.358923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.359895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360418 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.360844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361425 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.361845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.362794 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363108 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363641 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363747 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.363954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.364919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365023 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.365998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366313 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.366936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367782 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.367906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368100 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.368843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.369833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.370045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.370150 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.370366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.370482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.371375 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.371542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.371664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.371780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.371780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372005 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372614 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 04:46:15.372739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.372739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.373034 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.373391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 04:46:15.373639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 04:46:15.433631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO dbcounter [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Registered counter for database nova_api Jun 07 04:46:15.436594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO dbcounter [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Registered counter for database nova_api Jun 07 04:46:15.456109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.457731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_db.sqlalchemy.engines [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.463235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writer thread running {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.465420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writer thread running {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.521792 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.context [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6(cell1) {{(pid=124422) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 04:46:15.522804 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.context [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6(cell1) {{(pid=124421) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 04:46:15.526513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:46:15.527035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:46:15.528461 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:46:15.528633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:46:15.529715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:46:15.530116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:46:15.531688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:46:15.532481 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:46:15.534777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO dbcounter [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Registered counter for database nova_cell0 Jun 07 04:46:15.535835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO dbcounter [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Registered counter for database nova_cell0 Jun 07 04:46:15.541318 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO dbcounter [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Registered counter for database nova_cell1 Jun 07 04:46:15.541806 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO dbcounter [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Registered counter for database nova_cell1 Jun 07 04:46:15.549739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_db.sqlalchemy.engines [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.551205 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.555499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writer thread running {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.556064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writer thread running {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.556768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.700835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_db.sqlalchemy.engines [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.704252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writer thread running {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.705726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writer thread running {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.714134 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO dbcounter [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Registered counter for database nova_cell0 Jun 07 04:46:15.715674 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO dbcounter [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Registered counter for database nova_cell0 Jun 07 04:46:15.724776 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_db.sqlalchemy.engines [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.724975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 04:46:15.729916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writer thread running {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:15.730048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writer thread running {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 04:46:16.174992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: WARNING keystonemiddleware.auth_token [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:46:16.182328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: WARNING keystonemiddleware.auth_token [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:46:16.187584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: WARNING keystonemiddleware.auth_token [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:46:16.194840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: WARNING keystonemiddleware.auth_token [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:46:16.409497 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: WARNING keystonemiddleware.auth_token [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:46:16.415474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: WARNING keystonemiddleware.auth_token [None req-bd49b077-6b68-474d-8d00-c65df76d006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:46:16.419193 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: WARNING keystonemiddleware.auth_token [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 04:46:16.421871 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d586a9c0 pid: 124422 (default app) Jun 07 04:46:16.425468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: WARNING keystonemiddleware.auth_token [None req-ca66c8f5-d4dc-4061-b14b-1b650b5bbe8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 04:46:16.430477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d586a9c0 pid: 124421 (default app) Jun 07 04:46:58.228527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.229435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.230717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.232020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.795927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.797885 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.798485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:58.799478 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:46:59.770634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-58322e7f-a442-4554-9157-d7d11df0986f tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Action: 'create', calling method: .version_select at 0x7f3d5fc825e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-880001092", "metadata": {"Type": "work"}}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:00.508868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-802173563", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "networks": [{"uuid": "978ddba9-e39e-40d6-929e-5437cc2ec514"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:01.651289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] validate_networks() for [('978ddba9-e39e-40d6-929e-5437cc2ec514', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:47:02.332030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-58322e7f-a442-4554-9157-d7d11df0986f tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.108073 Jun 07 04:47:02.339524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Jun 7 04:46:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4118 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 04:47:02.349621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f3d15b50-8dea-4f7c-ac49-5266cb8f5cba tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5fb4c5e0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:02.665982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f3d15b50-8dea-4f7c-ac49-5266cb8f5cba tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 200 len: 352 microversion: 2.1 time: 0.324321 Jun 07 04:47:02.680374 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:02 2022] GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 352 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:03.142977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:47:03.143822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:47:03.144943 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:47:03.146508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:47:03.147710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:47:03.212553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:03.214973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:03.217335 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:03.222369 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:03.324930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Getting quotas for project e3e3dee338084a54a35d5798f4d5029d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:47:03.343175 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Getting quotas for user dd6d1211ed76450ab273cf274a0f7f02 and project e3e3dee338084a54a35d5798f4d5029d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:47:03.369038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:47:03.378137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:47:03.587054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cd8fcd7b-9cd8-4db3-8dd9-43946825d615 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.798970 Jun 07 04:47:03.588157 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:47:03.601611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-337ccb8d-b89b-4b3a-8398-b81ebbadb103 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:03.602913 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-337ccb8d-b89b-4b3a-8398-b81ebbadb103 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:03.698434 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-79733ff7-0eb9-40be-8d93-a3d4a3bef7b0 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5f2885e0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:03.852274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-337ccb8d-b89b-4b3a-8398-b81ebbadb103 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:03.858840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-79733ff7-0eb9-40be-8d93-a3d4a3bef7b0 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 200 len: 353 microversion: 2.1 time: 0.177969 Jun 07 04:47:03.859407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:03 2022] GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:03.870338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-337ccb8d-b89b-4b3a-8398-b81ebbadb103 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1214 microversion: 2.1 time: 0.275408 Jun 07 04:47:03.870631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3436fac3-c402-45a4-9155-e1b88f98bc22 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5ea6af70>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:03.899281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:03 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:03.954823 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3436fac3-c402-45a4-9155-e1b88f98bc22 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 200 len: 353 microversion: 2.1 time: 0.087592 Jun 07 04:47:03.955663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:03 2022] GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:03.973637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-56f80184-7169-4e36-abac-a82dbf42aa62 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5fb23040>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:04.088666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-56f80184-7169-4e36-abac-a82dbf42aa62 tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 202 len: 0 microversion: 2.1 time: 0.120161 Jun 07 04:47:04.089945 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 04:47:03 2022] DELETE /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:47:04.098133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-712c27d9-774e-4fa0-acdc-6582e44d815a tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5ea74670>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:04.265734 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-712c27d9-774e-4fa0-acdc-6582e44d815a tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 200 len: 352 microversion: 2.1 time: 0.171403 Jun 07 04:47:04.267261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:04 2022] GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:47:04.889619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1e91cfd8-ca61-4a50-b7e7-cc887a23c6ef tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:04.890535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1e91cfd8-ca61-4a50-b7e7-cc887a23c6ef tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:05.152998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1e91cfd8-ca61-4a50-b7e7-cc887a23c6ef tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:05.167826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1e91cfd8-ca61-4a50-b7e7-cc887a23c6ef tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1214 microversion: 2.1 time: 0.283603 Jun 07 04:47:05.179115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:04 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:05.283570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d9610b58-492f-4961-8674-b9febe24420d tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Calling method '.version_select at 0x7f3d5ea74d30>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:05.372326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-d9610b58-492f-4961-8674-b9febe24420d tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] HTTP exception thrown: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d9610b58-492f-4961-8674-b9febe24420d tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Request method failure captured: Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 HTTP/1.1 Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthCwD7pj1U_3mbfEMzjSVfEuDftmGwsPuIjjjNFEufocg0zj5F1pLH8w3kZYDbWAoZ2bOYDrRLbDnHfPQ1WQOmvs4iuLp9O5mjXus0pQ9YQ1lB7zfuwkh7nRxLWMCB6sKzsEsDdGr71TP7PoNMsAz6vM5E-PoFXebINrJKrpIUz_EM Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: c9edc1d94a6a4ab5958ea47cb64bba8a Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesGetTestJSON-151652658 Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:47:05.377966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9edc1d94a6a4ab5958ea47cb64bba8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9edc1d94a6a4ab5958ea47cb64bba8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9edc1d94a6a4ab5958ea47cb64bba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9edc1d94a6a4ab5958ea47cb64bba8a"}]}] Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesGetTestJSON-151652658 Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: c9edc1d94a6a4ab5958ea47cb64bba8a Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesGetTestJSON-151652658 Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesGetTestJSON-151652658-project Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 5d0eeeef18bc4f7d8fc2e15a70703f19 Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesGetTestJSON-151652658-project Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '24791e3f-41af-4b5b-bcaf-87ed2ce67e13'} Jun 07 04:47:05.379415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. (HTTP 404) (Request-ID: req-562c6d89-10b4-40b8-9bfc-00bc5a48a2cc) Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:47:05.380261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 04:47:05.381494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 04:47:05.382439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d9610b58-492f-4961-8674-b9febe24420d tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] Returning 404 to user: Volume 24791e3f-41af-4b5b-bcaf-87ed2ce67e13 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:47:05.383312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d9610b58-492f-4961-8674-b9febe24420d tempest-VolumesGetTestJSON-151652658 tempest-VolumesGetTestJSON-151652658-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13" status: 404 len: 109 microversion: 2.1 time: 0.100111 Jun 07 04:47:05.390051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:05 2022] GET /compute/v2.1/os-volumes/24791e3f-41af-4b5b-bcaf-87ed2ce67e13 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:47:06.196881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:06.198718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:06.233892 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:06.238867 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:06.242876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:06.243820 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:07.393409 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:07.415636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2ca04a6d-73fd-4bef-b769-e6048a6b64e9 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1210 microversion: 2.1 time: 1.224027 Jun 07 04:47:07.431852 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:06 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1210 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:08.436357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:08.437765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:08.465988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:08.468179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:08.469425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:08.470156 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:08.927932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:08.983133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2011d7ce-1a71-4b96-916e-4a539d9ed2d8 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.547660 Jun 07 04:47:08.986448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:08 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:10.003774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:10.005127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:10.018501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:10.020831 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:10.021864 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:10.023464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:10.279683 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:10.287889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e0dcf1c5-2945-4910-bfdd-93f4ae431717 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.291692 Jun 07 04:47:10.292827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:09 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:11.024639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-79d29871-bb33-4e69-9685-89f050cb67ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: .version_select at 0x7f3d5e963d30>, body: {"keypair": {"name": "tempest-keypair-1936679410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP//F9s/ZQs17ISieNzIUcLOnmGwVCugUQdd4oKI09FBxouzrti0sLWBd2N+b1VMKgsd7XAyOUQMzizcB8O35vNIhZPlz7wr0r8KzHdlwxa2SdkZaSLpAAqpmUMyxGcB+Q=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:11.077564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-79d29871-bb33-4e69-9685-89f050cb67ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:47:11.085983 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-79d29871-bb33-4e69-9685-89f050cb67ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for user 68a87c36e92b4dccbff62094846335f0 and project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:47:11.150334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-79d29871-bb33-4e69-9685-89f050cb67ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.414021 Jun 07 04:47:11.154363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 7/14] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:47:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:11.313946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:11.315174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:11.329730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:11.332962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:11.334291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:11.335847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:11.518301 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:11.534441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-91b0da17-98b8-41f0-927a-5bf59b1e1e25 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.228661 Jun 07 04:47:11.538161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:11 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:11.836171 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-233436689", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:11.975502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] validate_networks() for [('5d86967f-e870-4525-94fe-c4c482d45be3', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:47:12.563086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:12.564739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:12.604085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:12.604535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:12.606509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:12.607241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:12.922602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:12.932043 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f5d221aa-ff59-4c8f-a8ce-d3a0a71079ea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.380711 Jun 07 04:47:12.945807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 9/16] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:12 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:13.070560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:47:13.071068 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:47:13.071701 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:47:13.072205 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:47:13.072749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:47:13.087793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:13.089705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:13.093076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:13.093906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:13.138269 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:47:13.150212 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for user f4b50b2d16134e02b13989bc2579a337 and project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:47:13.182155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:47:13.186606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:47:13.311899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-287f0ef0-a70f-4399-8749-60703fa026ea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.822088 Jun 07 04:47:13.317737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 8/17] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:47:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 04:47:13.328592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f5f424b5-d192-4e6f-9e25-6bf41728c4fc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:13.329594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f5f424b5-d192-4e6f-9e25-6bf41728c4fc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:13.553700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f5f424b5-d192-4e6f-9e25-6bf41728c4fc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:13.562811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f5f424b5-d192-4e6f-9e25-6bf41728c4fc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1221 microversion: 2.1 time: 0.238682 Jun 07 04:47:13.597014 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 10/18] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:13 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:13.964065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:13.964729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:13.994613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:13.995709 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:13.999615 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:14.001073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:14.172011 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-130832737", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:14.237595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:14.262887 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-47f8ca82-2643-402c-a5a2-4e4e3a0f6c7b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.293596 Jun 07 04:47:14.277822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 9/19] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:13 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:14.405667 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] validate_networks() for [('5d86967f-e870-4525-94fe-c4c482d45be3', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:47:15.294304 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:15.294979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:15.310723 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:15.313044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:15.314823 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:15.317496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:15.862043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:15.876062 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ff70f0ab-d23c-4a87-ac5d-7e7846224fe3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1272 microversion: 2.1 time: 0.592075 Jun 07 04:47:15.878923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 10/20] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:15 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1272 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:16.215306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:47:16.215987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:47:16.222305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:47:16.226090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:47:16.226090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:47:16.276360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:16.284685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:16.288599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:16.292241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:16.390776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:47:16.412666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for user f4b50b2d16134e02b13989bc2579a337 and project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:47:16.445269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:47:16.451537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:47:16.552243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c5952504-45cb-4d5b-83ae-0fee71521c6c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.388400 Jun 07 04:47:16.552955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 11/21] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:47:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:47:16.564320 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b6da2b7a-aafd-4366-9abc-ac1fb9be57e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:16.565939 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b6da2b7a-aafd-4366-9abc-ac1fb9be57e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:16.666222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b6da2b7a-aafd-4366-9abc-ac1fb9be57e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:16.681828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b6da2b7a-aafd-4366-9abc-ac1fb9be57e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1221 microversion: 2.1 time: 0.120867 Jun 07 04:47:16.694411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 11/22] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:16 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:16.894879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:16.895455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:16.915512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:16.917505 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:16.920001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:16.921834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:17.151092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:17.172552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-17b4e26d-755e-448b-86ed-118a0d2487c4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.282300 Jun 07 04:47:17.173135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:16 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:17.288222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-797576768", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0dc8a98-51e8-40e9-a052-24460dd80c5e"}], "security_groups": [{"name": "tempest-securitygroup--1822913714"}], "key_name": "tempest-keypair-1936679410", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:17.412458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] validate_networks() for [('b0dc8a98-51e8-40e9-a052-24460dd80c5e', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:47:17.708856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:17.710359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:17.750392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:17.751495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:17.753608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:17.754582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:17.849762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:17.861468 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f2f98154-7ad3-4f57-80cb-d311468bec3f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.158441 Jun 07 04:47:17.872150 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 13/24] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:17 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:18.073243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:47:18.073790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:47:18.074134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:47:18.075408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:47:18.076152 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:47:18.085019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.085497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.086284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.086717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.107883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:47:18.114204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for user 68a87c36e92b4dccbff62094846335f0 and project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:47:18.127891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:47:18.130122 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:47:18.189796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:18.190504 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:18.193568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2202980b-0dd2-4b2f-b821-9e872670d9d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.909630 Jun 07 04:47:18.195797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 12/25] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:47:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:47:18.207288 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.207992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.208961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.211427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.213599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8af6792b-60c6-4442-9d2b-ae1efa0803ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:18.214559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8af6792b-60c6-4442-9d2b-ae1efa0803ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:18.388759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8af6792b-60c6-4442-9d2b-ae1efa0803ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:18.397363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8af6792b-60c6-4442-9d2b-ae1efa0803ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1237 microversion: 2.1 time: 0.193985 Jun 07 04:47:18.398314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:18 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:18.486052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:18.496074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-32651f56-10ca-43b2-bc94-23862114bab1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.310336 Jun 07 04:47:18.497873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:18 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:18.879225 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:18.881049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:18.888431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.889069 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.889880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:18.890318 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:18.991988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:19.006970 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4e53589b-bac8-4946-a90f-2655c9d3cf14 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.131732 Jun 07 04:47:19.013317 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 14/28] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:18 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:19.416535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:19.417158 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:19.424390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:19.425328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:19.426230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:19.426739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:19.516905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:19.517602 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:19.530594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:19.531501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:19.532680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:19.533189 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:19.569028 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:19.581611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-55fca534-42cb-493f-9d7b-e06d22e7c53e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.169736 Jun 07 04:47:19.582313 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 15/29] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:19 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:19.823451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:19.832237 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-40ba0af8-9d8f-4756-9bec-fea1d14e3101 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.321308 Jun 07 04:47:19.833034 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 15/30] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:19 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:19.950682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9af61792-c508-4f0d-99bf-1c679afe867b tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f16ec10>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:20.023345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9af61792-c508-4f0d-99bf-1c679afe867b tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d9e570d0-6fec-4d5c-a185-13a7699f988e" status: 200 len: 351 microversion: 2.1 time: 0.077923 Jun 07 04:47:20.023965 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 16/31] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:19 2022] GET /compute/v2.1/os-volumes/d9e570d0-6fec-4d5c-a185-13a7699f988e => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:20.029875 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:20.030888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:20.047460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.048200 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:20.049270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.049984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:20.157266 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:20.179356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-21059da9-26b4-4856-b4f2-d38d761ed23b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.158001 Jun 07 04:47:20.180255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 16/32] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:20 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:20.600030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:20.600647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:20.613179 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.616758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:20.618991 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.622271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:20.806131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:20.820279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cb0cfc85-b683-48c3-bd77-7c554c174854 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.224639 Jun 07 04:47:20.820894 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 17/33] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:20 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:20.850895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:20.851504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:20.864541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.864987 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:20.866198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:20.868384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:21.104883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:21.118364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f1bc3ac1-fe49-4203-b2d6-446eda53a9a5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.271673 Jun 07 04:47:21.119172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 17/34] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:20 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:21.195774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:21.214727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:21.232758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:21.233277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:21.234056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:21.237322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:21.335968 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:21.356195 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5071d1eb-1f70-4f38-b52a-2848a4189c81 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.162685 Jun 07 04:47:21.358592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 18/35] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:21 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:21.693447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-27d8962f-bedc-4a78-bc15-0883358ccb5d tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5e8ea040>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:21.839487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:21.841517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:21.863075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:21.864185 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:21.865270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:21.866138 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:21.921330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-27d8962f-bedc-4a78-bc15-0883358ccb5d tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a2e77896-49b2-4422-893d-f56e476f6433" status: 200 len: 351 microversion: 2.1 time: 0.232464 Jun 07 04:47:21.922550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 18/36] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:21 2022] GET /compute/v2.1/os-volumes/a2e77896-49b2-4422-893d-f56e476f6433 => generated 351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:21.967092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:21.991769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-abb84b94-8bbc-4350-91e7-eec2ece4b01c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.155298 Jun 07 04:47:21.993404 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 19/37] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:21 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:22.136865 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:22.137511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:22.144636 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:22.147741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:22.148788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:22.149565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:22.376020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:22.376847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:22.396545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:22.399902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:22.406527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:22.407437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:22.520160 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:22.534050 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4cd74d5a-4b52-4e7e-aac4-7ccfabfb088b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.401551 Jun 07 04:47:22.547283 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:22 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:22.583618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:22.593412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f7aac21b-c70b-42a5-ab8f-cf3144895599 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.222789 Jun 07 04:47:22.602360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 20/39] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:22 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:23.009561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:23.010607 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:23.020185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.020882 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.022578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.023632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.118370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:23.149189 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9fa07798-4c41-40f2-8ab7-d131d7b5aa1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.141837 Jun 07 04:47:23.149852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:23 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:23.554031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:23.554703 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:23.560905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.561396 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.562173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.562644 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.612061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:23.612876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:23.624926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.625874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.627176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:23.628067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:23.750522 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:23.764341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-df876a9b-85f7-48a0-9b8a-6f6b3939a179 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.153496 Jun 07 04:47:23.765313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 21/41] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:23 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:23.792905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:23.801214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bd22505e-8639-4ac9-b480-6640545b66f2 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.251326 Jun 07 04:47:23.802791 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 21/42] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:23 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:24.169579 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:24.170328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:24.180015 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.180534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.181451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.181966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.250092 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:24.258990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3405c0ea-337b-44aa-aaf5-d9abd8528927 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.095100 Jun 07 04:47:24.259792 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:24 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:24.782313 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:24.782977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:24.790869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.791360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.792416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.792890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.829141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:24.830077 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:24.837540 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.839974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.866435 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:24.866900 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:24.876640 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:24.891008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0b65c331-ace8-46e3-855a-9dcfd6b889bc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.113235 Jun 07 04:47:24.892154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 22/44] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:24 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:24.905616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8c23c518-641c-4777-8c9e-b6e7858cc58c tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f14ab80>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:24.983747 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8c23c518-641c-4777-8c9e-b6e7858cc58c tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/bf7140e4-e159-4944-abc6-b32e480561de" status: 200 len: 350 microversion: 2.1 time: 0.090027 Jun 07 04:47:24.984906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 23/45] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:47:24 2022] GET /compute/v2.1/os-volumes/bf7140e4-e159-4944-abc6-b32e480561de => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:25.003566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9ddb1e7-287c-4318-84e0-6d791d26e213 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f16ea60>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.143728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:25.157866 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ef0f0070-9869-4173-b3a8-24de9b474069 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.337460 Jun 07 04:47:25.165919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:24 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:25.189325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9ddb1e7-287c-4318-84e0-6d791d26e213 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.187366 Jun 07 04:47:25.190006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 24/47] 10.222.0.40 () {58 vars in 1133 bytes} [Tue Jun 7 04:47:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:25.203514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8b5399af-85cb-4380-8116-e3a64c4e7861 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5e8c8670>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.280095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.280095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:25.289587 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:25.289964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:25.290752 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:25.291205 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:25.393529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:25.402941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-731a0d57-7e1b-4357-8d61-2ab395881f39 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1241 microversion: 2.1 time: 0.128715 Jun 07 04:47:25.405395 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:25 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:25.422708 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8b5399af-85cb-4380-8116-e3a64c4e7861 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222639 Jun 07 04:47:25.424109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 24/49] 10.222.0.40 () {58 vars in 1148 bytes} [Tue Jun 7 04:47:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:25.438994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b4e8a407-a060-41cc-93fc-4494c0b9fb59 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f16e670>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.885865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b4e8a407-a060-41cc-93fc-4494c0b9fb59 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.451674 Jun 07 04:47:25.887110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 26/50] 10.222.0.40 () {58 vars in 1133 bytes} [Tue Jun 7 04:47:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:25.899240 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cd77fb00-c34b-4ae7-8864-9bcae2b92bab tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5e91b5e0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.910524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:25.911143 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:25.932616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:25.933259 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:25.935444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:25.935902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:26.116948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:26.146325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5a827a95-6bf2-4546-9294-21ef4a43d3ca tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1225 microversion: 2.1 time: 0.236423 Jun 07 04:47:26.149364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 27/51] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:25 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1225 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:26.176632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:26.178002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:26.187098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cd77fb00-c34b-4ae7-8864-9bcae2b92bab tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.292278 Jun 07 04:47:26.188328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 25/52] 10.222.0.40 () {58 vars in 1166 bytes} [Tue Jun 7 04:47:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:26.196948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:26.203110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:26.204971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:26.206313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1736da92-f910-4d31-a849-eb7e3319c209 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5e0a5a60>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:26.207424 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:26.219129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:26.360952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:26.437666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=12 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:26.521681 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1736da92-f910-4d31-a849-eb7e3319c209 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.320040 Jun 07 04:47:26.522271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 26/53] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:47:26.538432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:26.540397 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:26.556620 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:26.558632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:26.559400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:26.559942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:26.618368 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:26.636352 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-00169727-0424-4af2-ac9b-b25ae1aa0c38 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.465187 Jun 07 04:47:26.647077 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 28/54] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:26.652709 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-121f7ec5-bc21-429d-b6e2-af78c7344840 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f14a940>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:26.711297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:26.725066 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-351c20ee-c401-489c-8853-0a503bb0cfd8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1233 microversion: 2.1 time: 0.191126 Jun 07 04:47:26.737448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 27/55] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1233 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:26.789945 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-121f7ec5-bc21-429d-b6e2-af78c7344840 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.141531 Jun 07 04:47:26.790806 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 29/56] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:26.805257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2154cfe7-b821-445f-8f02-bf1f2634fe56 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5e0a5430>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:26.924990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2154cfe7-b821-445f-8f02-bf1f2634fe56 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.124206 Jun 07 04:47:26.925726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 28/57] 10.222.0.40 () {58 vars in 1187 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:26.940467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-87990193-3a93-42fd-b92e-ed25a1cca422 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] Calling method '.version_select at 0x7f3d5f16ef70>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:27.088502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-87990193-3a93-42fd-b92e-ed25a1cca422 tempest-VolumesTestJSON-1503068422 tempest-VolumesTestJSON-1503068422-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.153785 Jun 07 04:47:27.089385 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 30/58] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Jun 7 04:47:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:27.166888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:27.167726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:27.176275 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.180560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.181650 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.182086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.267409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:27.275791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-83370653-9a14-49a2-abd7-1246ff495653 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1217 microversion: 2.1 time: 0.112996 Jun 07 04:47:27.285547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:27 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:27.652960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:27.654399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:27.675750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.676384 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.677395 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.678982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.743781 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:27.744637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:27.749267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:27.764924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.765623 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.766490 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:27.766943 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:27.901874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:27.924840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6eb2f601-8d97-4c41-93c3-edaf79600b5d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1233 microversion: 2.1 time: 0.183293 Jun 07 04:47:27.934839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 30/60] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:27 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1233 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:27.969037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:27.977894 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-252cb996-848d-42db-8908-2a48c4f77439 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.328918 Jun 07 04:47:27.978463 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:27 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:28.038821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-3cddc753-4726-4c2d-a9e3-4f4dfc73a2aa req-da2b1d5c-6a7a-4829-a05d-07398a43fe0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebc0915-9fee-4e7c-8df4-20a75bfbb797", "tag": "7c1442ce-5bc3-4c24-8c1e-33cad9e2560f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:28.059788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-3cddc753-4726-4c2d-a9e3-4f4dfc73a2aa req-da2b1d5c-6a7a-4829-a05d-07398a43fe0a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.060331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-3cddc753-4726-4c2d-a9e3-4f4dfc73a2aa req-da2b1d5c-6a7a-4829-a05d-07398a43fe0a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.087215 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-3cddc753-4726-4c2d-a9e3-4f4dfc73a2aa req-da2b1d5c-6a7a-4829-a05d-07398a43fe0a service nova] Creating event network-changed:7c1442ce-5bc3-4c24-8c1e-33cad9e2560f for instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 on hv-cinder-83699 Jun 07 04:47:28.087755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-3cddc753-4726-4c2d-a9e3-4f4dfc73a2aa req-da2b1d5c-6a7a-4829-a05d-07398a43fe0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124421) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 04:47:28.088926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.089576 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.100092 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.100577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.105892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:28.110583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:28.127921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.compute.rpcapi [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 04:47:28.128871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] Releasing lock "compute-rpcapi-router" {{(pid=124421) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 04:47:28.159099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5f8a135a-c4b4-4691-ae94-8f6582e78754 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206104 Jun 07 04:47:28.159914 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 31/62] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:47:28.293606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:28.294859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:28.297125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:28.302931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.303602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.304543 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.305136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.378309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:28.387976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-743a4e9e-8241-4936-bce9-8d5919f4a6f9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1217 microversion: 2.1 time: 0.098797 Jun 07 04:47:28.389020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 32/63] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:28 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:28.940030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=26 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:28.944218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:28.944910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:28.958644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.959484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:28.960290 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:28.960646 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:29.002820 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:29.003450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:29.015118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:29.015612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:29.016436 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:29.016993 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:29.323342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:29.356859 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7e54a765-4e38-4ac7-b4ac-690485f0e3ed tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1289 microversion: 2.1 time: 0.414135 Jun 07 04:47:29.357606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 32/64] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:28 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1289 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:29.414754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:29.415784 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:29.423283 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:29.423738 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:29.424553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:29.425113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:29.581673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:29.592231 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-31d2cd06-1b72-4e6e-9b24-455f8219441e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1273 microversion: 2.1 time: 0.182144 Jun 07 04:47:29.606368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 33/65] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:29 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:30.000538 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:30.014128 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1ab12071-90bc-4e31-95db-cd328f6d228e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 1.018037 Jun 07 04:47:30.014819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 33/66] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:28 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:30.374937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:30.375558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:30.382669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:30.383351 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:30.384279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:30.384870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:30.557763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:30.574345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-75bc2fd7-c487-4899-a536-6f686cc6c03a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1295 microversion: 2.1 time: 0.198487 Jun 07 04:47:30.581957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 34/67] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:30 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:30.624237 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:30.624944 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:30.634201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:30.635273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:30.636561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:30.637269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:30.810255 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:30.819706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9f88a244-207d-455f-9b39-208751c5d981 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1279 microversion: 2.1 time: 0.201010 Jun 07 04:47:30.820291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 34/68] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:30 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:31.032468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:31.034049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:31.045519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.046259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:31.054932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.058159 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:31.535877 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:31.547677 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-eb54a097-10d1-457e-b154-d0c7cf850c83 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.519344 Jun 07 04:47:31.550856 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 35/69] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:31 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:31.604442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:31.605160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:31.619080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.620420 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:31.622003 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.622455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:31.816493 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:31.836352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:31.837515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:31.840609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-47e64a95-5ba9-4198-91bf-9eafcc1f9a43 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1295 microversion: 2.1 time: 0.245803 Jun 07 04:47:31.844969 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 35/70] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:31 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1295 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:31.854353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.855124 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:31.857432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:31.858161 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:32.013912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:32.025396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b40aaca1-901a-41b6-9fc7-39ddaad20549 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1279 microversion: 2.1 time: 0.193051 Jun 07 04:47:32.027807 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 36/71] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:31 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:32.569287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:32.570702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:32.583333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:32.584751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:32.586052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:32.587928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:32.860259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:32.862324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:32.876306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:32.876969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:32.878043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:32.878679 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:33.141900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:33.172346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c19b2972-0c4d-4540-bbaf-904b734ea874 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.607642 Jun 07 04:47:33.178808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 36/72] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:32 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:33.194281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:33.195921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:33.215525 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:33.217342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:33.218714 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:33.219676 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:33.518372 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:33.533720 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fafa57a7-54e6-4bc0-a406-54ba07134aa0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.676843 Jun 07 04:47:33.535271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 37/73] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:32 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:33.625264 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:33.641436 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ca80fa47-ea48-4933-a6c0-70c7ec8151d2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.461300 Jun 07 04:47:33.652784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 37/74] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:33 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:34.195928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:34.196744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:34.203908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.204652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.205548 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.206058 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.301126 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-c6c50859-39c8-41b9-bd50-4bee74f537e1 req-1626ec56-81bc-4b90-9c9c-161375f83755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ac6b6c-d38b-4b7d-9200-833ed36cc465", "tag": "efcb93a9-49dd-438d-add9-d3f7801582eb"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:34.310089 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c6c50859-39c8-41b9-bd50-4bee74f537e1 req-1626ec56-81bc-4b90-9c9c-161375f83755 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.310545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c6c50859-39c8-41b9-bd50-4bee74f537e1 req-1626ec56-81bc-4b90-9c9c-161375f83755 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.322755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-c6c50859-39c8-41b9-bd50-4bee74f537e1 req-1626ec56-81bc-4b90-9c9c-161375f83755 service nova] Creating event network-changed:efcb93a9-49dd-438d-add9-d3f7801582eb for instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 on hv-cinder-83699 Jun 07 04:47:34.328900 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-c6c50859-39c8-41b9-bd50-4bee74f537e1 req-1626ec56-81bc-4b90-9c9c-161375f83755 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335317 Jun 07 04:47:34.329473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 38/75] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:34.354343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:34.362658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ee5efbd5-49fa-45de-aaea-ed610bfdfe72 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.171136 Jun 07 04:47:34.363574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 38/76] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:34 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:34.554783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:34.555745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:34.566932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.567695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.568536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.577637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.660567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:34.662240 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:34.675038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.675577 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:34.680632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:34.681159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:35.107835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:35.116119 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b458aa91-cb08-442e-8c07-274db44b06eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.567504 Jun 07 04:47:35.121357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 39/77] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:34 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:35.258499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:35.273501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d5f934c5-6f48-4b57-8aaf-73efb0390d65 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.617767 Jun 07 04:47:35.276068 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 39/78] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:34 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:35.380975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:35.381661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:35.387727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:35.388405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:35.389649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:35.390456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.003918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-c7dc2235-be9f-4160-86cd-1d76de50cb87 req-ec24330e-5256-4aa8-96a8-40a4a3734c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce359ec-5b2a-4c16-bb00-7b12798ec4d5", "tag": "db037bae-92bb-4b9a-916d-da9f24caf5a4"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:36.059500 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-c7dc2235-be9f-4160-86cd-1d76de50cb87 req-ec24330e-5256-4aa8-96a8-40a4a3734c3d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.062885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-c7dc2235-be9f-4160-86cd-1d76de50cb87 req-ec24330e-5256-4aa8-96a8-40a4a3734c3d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.157402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-c7dc2235-be9f-4160-86cd-1d76de50cb87 req-ec24330e-5256-4aa8-96a8-40a4a3734c3d service nova] Creating event network-changed:db037bae-92bb-4b9a-916d-da9f24caf5a4 for instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 on hv-cinder-83699 Jun 07 04:47:36.158606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-c7dc2235-be9f-4160-86cd-1d76de50cb87 req-ec24330e-5256-4aa8-96a8-40a4a3734c3d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124422) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 04:47:36.181407 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.182748 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.191741 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.193660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.232872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.compute.rpcapi [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 04:47:36.246958 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] Releasing lock "compute-rpcapi-router" {{(pid=124422) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 04:47:36.288059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:36.298463 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-477685d9-6358-41ff-871e-46ccd56e8bf5 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.921731 Jun 07 04:47:36.312166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 40/79] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:35 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:36.322022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:36.331621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:36.346353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.351912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.352276 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1dc3538e-351b-4101-9128-89389893cd54 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355175 Jun 07 04:47:36.353280 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 40/80] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:36.358349 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.359032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.362247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:36.363110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:36.381016 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.384184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.388652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:36.392886 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:36.973663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:36.985308 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-49e79113-e080-498a-b6f4-121dda8b362e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.670571 Jun 07 04:47:36.985923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 41/81] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:36 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:37.066934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:37.075399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-14374a39-c7b2-4714-8f1e-75c7a0eacbd2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.720863 Jun 07 04:47:37.085343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:36 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:37.316496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:37.317109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:37.323205 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:37.324302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:37.325163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:37.325633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:37.482112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:37.491466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9ffeb1e2-4406-4d91-a5c3-34fea75b435b tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.178163 Jun 07 04:47:37.491632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 42/83] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:37 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:38.007117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:38.008933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:38.022719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.023452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.025458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.027542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.094855 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:38.095637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:38.102854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.103297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.107457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.111601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.119924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:38.293561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:38.305033 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b6ba6bdc-164d-463f-9842-08322722b4a8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.305333 Jun 07 04:47:38.306110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 42/84] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:37 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:38.389498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:38.397739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-31391612-fd69-4a95-82ae-324d2df896f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.308782 Jun 07 04:47:38.398497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 43/85] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:38 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:38.507737 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:38.508868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:38.517510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.518249 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.520202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.520872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.698162 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:38.707733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6c5ef596-ced5-4201-a42e-b7bc5a8fbe59 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.204158 Jun 07 04:47:38.708325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 43/86] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:38 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:38.914603 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-ce383738-ac8e-46d2-954c-b111db34cad8 req-52e4ce59-9d84-4a23-b297-2d7ad52ba907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fa9ff3-99a4-41d3-8492-a3a240d6d73e", "tag": "db28e18b-ffdc-4a2e-84c0-e448e43554aa"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:38.926654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-ce383738-ac8e-46d2-954c-b111db34cad8 req-52e4ce59-9d84-4a23-b297-2d7ad52ba907 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:38.927105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-ce383738-ac8e-46d2-954c-b111db34cad8 req-52e4ce59-9d84-4a23-b297-2d7ad52ba907 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:38.960320 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-ce383738-ac8e-46d2-954c-b111db34cad8 req-52e4ce59-9d84-4a23-b297-2d7ad52ba907 service nova] Creating event network-changed:db28e18b-ffdc-4a2e-84c0-e448e43554aa for instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e on hv-cinder-83699 Jun 07 04:47:38.966487 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-ce383738-ac8e-46d2-954c-b111db34cad8 req-52e4ce59-9d84-4a23-b297-2d7ad52ba907 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055487 Jun 07 04:47:38.967906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 44/87] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:39.324594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:39.325277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:39.337999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.338652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.340113 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.340861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.415336 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:39.417424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:39.428963 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.431396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.434484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.435678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.543681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:39.553938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-98fb0617-6610-4100-a50e-16be04da355b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.234568 Jun 07 04:47:39.558502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 44/88] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:39 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:39.739238 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:39.739784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:39.752571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.763821 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.767197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:39.770830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:39.838537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:39.851338 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f01a4854-3925-4901-9baf-9d0804ec371f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.439170 Jun 07 04:47:39.852805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 45/89] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:39 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:40.063241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:40.072797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1e1b5251-2083-4acf-84fc-7eb3c5840caa tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.351492 Jun 07 04:47:40.074221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 45/90] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:39 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:40.346329 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-f947d573-bee2-47e7-b9ef-49d83cf0ae0d req-f1df5c8b-7195-42e4-a2ce-0bf72de37659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebc0915-9fee-4e7c-8df4-20a75bfbb797", "name": "network-vif-plugged", "status": "completed", "tag": "7c1442ce-5bc3-4c24-8c1e-33cad9e2560f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:40.354526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f947d573-bee2-47e7-b9ef-49d83cf0ae0d req-f1df5c8b-7195-42e4-a2ce-0bf72de37659 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:40.355221 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f947d573-bee2-47e7-b9ef-49d83cf0ae0d req-f1df5c8b-7195-42e4-a2ce-0bf72de37659 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:40.367086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-f947d573-bee2-47e7-b9ef-49d83cf0ae0d req-f1df5c8b-7195-42e4-a2ce-0bf72de37659 service nova] Creating event network-vif-plugged:7c1442ce-5bc3-4c24-8c1e-33cad9e2560f for instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 on hv-cinder-83699 Jun 07 04:47:40.372394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-f947d573-bee2-47e7-b9ef-49d83cf0ae0d req-f1df5c8b-7195-42e4-a2ce-0bf72de37659 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163021 Jun 07 04:47:40.372998 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 46/91] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:40.575458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:40.586601 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:40.592883 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:40.593372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:40.594145 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:40.594588 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:40.869056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:40.871230 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:40.883924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:40.885219 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:40.886247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:40.886852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:40.907411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:40.921884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d956afda-f016-4749-ae86-85999987d72a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.351269 Jun 07 04:47:40.922681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 46/92] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:40 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:41.067898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:41.076430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1f2d0168-8d8e-4411-acf4-fb706e7527bf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.212276 Jun 07 04:47:41.077453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 47/93] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:40 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:41.091350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:41.092647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:41.100082 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:41.100515 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:41.101508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:41.102232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:41.107267 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:41.269208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:41.278994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-67590c84-eb70-41a0-beca-0142981e59ff tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.192607 Jun 07 04:47:41.279873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 47/94] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:41 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:41.939643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:41.940869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:41.947338 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:41.947785 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:41.948774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:41.949394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:42.096383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:42.097147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:42.114568 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:42.115059 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:42.115872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:42.116290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:42.135919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:42.144306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-26a4a2a1-cccb-4724-916d-8278478bcb02 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.208437 Jun 07 04:47:42.144896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 48/95] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:41 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:42.296740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:42.297382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:42.304710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:42.305280 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:42.306253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:42.307094 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:42.308231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:42.319556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-97ddcea2-9938-4047-aaa5-c64db4ef3e3e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.228245 Jun 07 04:47:42.320690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 48/96] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:42 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:42.520220 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:42.530171 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2c78acd4-0ff8-46eb-bec1-9abdbf1d90f3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.238093 Jun 07 04:47:42.531265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 49/97] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:42 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:43.163284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:43.164094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:43.171075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.171536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.172314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.172761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.336038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:43.336814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:43.343513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.344237 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.345196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.345843 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.371185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:43.376823 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:43.397678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c79f5323-176f-46fa-976f-9d7312c9dacb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.230019 Jun 07 04:47:43.398764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 49/98] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:43 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:43.516870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:43.536881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e3e73b45-88ab-483c-8a72-ba3ef362f57d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.193488 Jun 07 04:47:43.539015 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:43 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:43.549109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:43.550554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:43.559312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.559782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.560565 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:43.560990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:43.754998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:43.763237 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f32e6386-abe1-4186-a3e3-894cea235458 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.218888 Jun 07 04:47:43.764053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 50/100] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:43 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:44.415969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:44.416572 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:44.423363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.423814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.424568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.425000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.560532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:44.561262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:44.570972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:44.575763 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.576220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.577007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.577470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.580220 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-eee2b7ac-c440-46d4-8510-78027a0ea7a6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.167910 Jun 07 04:47:44.581026 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 51/101] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:44 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:44.715967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:44.723837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3d8b4802-b7d7-4db8-8333-fe5335878855 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.168084 Jun 07 04:47:44.724420 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 51/102] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:44 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:44.781177 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:44.781827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:44.788043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.788497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.789287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:44.789748 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:44.924554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:44.931988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5d92f1cd-2f6d-4db5-8257-81e8e0d90090 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.155293 Jun 07 04:47:44.932570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 52/103] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:44 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:45.597997 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:45.598619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:45.604618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.605063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:45.605852 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.606293 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:45.739533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:45.741001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:45.742423 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:45.748669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9372b553-c642-4db2-b413-2a79c275ce29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.154399 Jun 07 04:47:45.749400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.749846 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:45.750876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.751307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:45.755399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 52/104] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:45 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:45.885726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:45.893264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0c36111d-91a6-4cc3-a11e-58270047883a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.156124 Jun 07 04:47:45.893829 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 53/105] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:45 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:45.947616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:45.948222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:45.954193 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.954638 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:45.955384 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:45.955812 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:46.080823 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:46.088166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f0305bc6-ac01-4553-96c0-6b3022c6361a tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.144281 Jun 07 04:47:46.088776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 53/106] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:45 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:46.766514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:46.767156 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:46.773480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:46.774090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:46.775041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:46.775474 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:46.911476 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:46.912428 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:46.914428 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:46.918969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:46.921772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:46.922273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:46.923356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:46.924366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:46.926878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a9788262-c60f-45a8-a190-6a25b0ea3bca tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.164263 Jun 07 04:47:46.927460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 54/107] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:46 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:47.066467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:47.075181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ab4298f4-eb12-4a17-93ea-23b2e2954eb4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.168283 Jun 07 04:47:47.075784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 54/108] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:46 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:47.104880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:47.105433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:47.111396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:47.111844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:47.112604 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:47.113038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:47.265695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:47.273750 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-01d5d865-9d27-4344-834c-80c8c371241f tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.172854 Jun 07 04:47:47.274801 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 55/109] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:47 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:47.943928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:47.944761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:47.951839 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:47.952294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:47.953055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:47.953673 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:48.093211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:48.093858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:48.101842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:48.102287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:48.103054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:48.103482 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:48.114893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:48.126206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-62398397-01ad-454f-803e-8b3a665b8bb3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.185965 Jun 07 04:47:48.130031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:47 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:48.283795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:48.290938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:48.291553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:48.293547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-03ab27d7-e573-4c66-858b-022f71d918f0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.204809 Jun 07 04:47:48.294580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 56/111] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:48 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:48.298329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:48.298781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:48.299557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:48.300034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:48.447118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:48.461511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e1354835-3feb-45c2-8ba2-1c5e8ee79a9e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.174292 Jun 07 04:47:48.462182 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 56/112] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:48 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:49.153425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:49.154078 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:49.161485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.161934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.163475 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.163918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.312152 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:49.312773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:49.320123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.320739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.321737 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.322328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.541567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:49.553491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-729d3d31-82fa-4365-973d-a5b1223d7879 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.405408 Jun 07 04:47:49.554217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:49 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:49.566591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:49.570600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:49.571574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:49.575301 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-690463cd-31b6-43b9-b21e-acb8ab402a69 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.267923 Jun 07 04:47:49.575634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 57/114] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:49 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:49.580904 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.582113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.583098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:49.585564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:49.811481 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:49.825072 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c5dd2261-a26b-4dec-8028-21b8b546c7a4 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.259882 Jun 07 04:47:49.826192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 58/115] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:49 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:50.573946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:50.574779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:50.589819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:50.595585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:50.598607 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:50.599788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:50.601002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:50.601911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:50.613392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:50.614214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:50.615230 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:50.615880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:51.019450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:51.031263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-aaaa5227-a5c5-4779-8df7-30dba6b1b702 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.464932 Jun 07 04:47:51.031865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 58/116] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:50 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:51.041460 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:51.041460 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:51.043619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:51.044121 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:51.045339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:51.046023 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:51.121340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:51.131902 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a3dbbe6a-06f4-42c8-8587-fcb4a60a51db tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.542408 Jun 07 04:47:51.143793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 59/117] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:50 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:51.233320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:51.242964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ac5ce0ea-34fa-4964-86bf-9d1c763ba7b1 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.210074 Jun 07 04:47:51.243825 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 59/118] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:51 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:52.048444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:52.049710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:52.056364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.056835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.057891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.058335 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.150197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:52.151655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:52.159318 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.161520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.162623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.163304 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.350163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:52.359347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-94e8a396-be31-4238-8d41-9fd0b01173b7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.315078 Jun 07 04:47:52.360104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 60/119] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:52 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:52.365299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-a97c9004-ef15-431f-9961-1bf8702fb061 req-24afd8d7-dd4e-45c5-b7ac-b24b9e6de9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ac6b6c-d38b-4b7d-9200-833ed36cc465", "name": "network-vif-plugged", "status": "completed", "tag": "efcb93a9-49dd-438d-add9-d3f7801582eb"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:52.374639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a97c9004-ef15-431f-9961-1bf8702fb061 req-24afd8d7-dd4e-45c5-b7ac-b24b9e6de9c2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.375765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a97c9004-ef15-431f-9961-1bf8702fb061 req-24afd8d7-dd4e-45c5-b7ac-b24b9e6de9c2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.390029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-a97c9004-ef15-431f-9961-1bf8702fb061 req-24afd8d7-dd4e-45c5-b7ac-b24b9e6de9c2 service nova] Creating event network-vif-plugged:efcb93a9-49dd-438d-add9-d3f7801582eb for instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 on hv-cinder-83699 Jun 07 04:47:52.402654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-a97c9004-ef15-431f-9961-1bf8702fb061 req-24afd8d7-dd4e-45c5-b7ac-b24b9e6de9c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040434 Jun 07 04:47:52.403625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 61/120] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:52.409825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:52.410886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:52.414869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:52.418110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.418756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.419771 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:52.420419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:52.424782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d4c1079f-ff50-443d-b0e8-75df03688986 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.278737 Jun 07 04:47:52.435294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 60/121] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:52 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:52.706519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:52.716289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b6722163-eaf1-4281-a7cc-ad983698d511 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.311259 Jun 07 04:47:52.716872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 62/122] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:52 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:53.376859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:53.378324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:53.386633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.390617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:53.394651 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.397589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:53.443066 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:53.444011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:53.452953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.457165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:53.458203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.459934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:53.791051 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:53.799619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a7dee801-b264-4ed0-8f34-019a21419221 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.427358 Jun 07 04:47:53.809765 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 61/123] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:53 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:53.816072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:53.819894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:53.824109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:53.830056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-10a6f8ab-555d-4ee8-a00e-3d1fd9113689 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.391290 Jun 07 04:47:53.851898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 63/124] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:53 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:53.861349 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.866464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:53.867445 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:53.867923 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:54.245700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:54.255218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-96b38725-b1c6-418f-bd4a-86db7b3efaac tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.443937 Jun 07 04:47:54.255870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 62/125] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:53 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:54.419527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-26729ac9-180d-47bd-b9b7-772f0f1a9984 req-2a35c9ea-6a0f-49c7-a7f5-63fffc3a90bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce359ec-5b2a-4c16-bb00-7b12798ec4d5", "name": "network-vif-plugged", "status": "completed", "tag": "db037bae-92bb-4b9a-916d-da9f24caf5a4"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:54.437545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-26729ac9-180d-47bd-b9b7-772f0f1a9984 req-2a35c9ea-6a0f-49c7-a7f5-63fffc3a90bf service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:54.439012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-26729ac9-180d-47bd-b9b7-772f0f1a9984 req-2a35c9ea-6a0f-49c7-a7f5-63fffc3a90bf service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:54.479660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-26729ac9-180d-47bd-b9b7-772f0f1a9984 req-2a35c9ea-6a0f-49c7-a7f5-63fffc3a90bf service nova] Creating event network-vif-plugged:db037bae-92bb-4b9a-916d-da9f24caf5a4 for instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 on hv-cinder-83699 Jun 07 04:47:54.489534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-26729ac9-180d-47bd-b9b7-772f0f1a9984 req-2a35c9ea-6a0f-49c7-a7f5-63fffc3a90bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Jun 07 04:47:54.489534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 64/126] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:47:54.815618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:54.816885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:54.823638 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:54.824366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:54.825424 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:54.825885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:54.851435 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:54.852403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:54.874676 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:54.875130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:54.876162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:54.876594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:55.051744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:55.057926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:55.066830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-42545ceb-39b0-4a4b-913f-7e47939dd427 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.254841 Jun 07 04:47:55.068202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 63/127] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:54 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:55.094783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:55.110202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-adb71f57-4e91-400b-a9a6-bf3258239d91 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.264904 Jun 07 04:47:55.111029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 65/128] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:54 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:55.272346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:55.273348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:55.290661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:55.291671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:55.293516 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:55.294163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:55.526501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:55.545645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4057a04c-eb6d-445b-9e02-79773ccfcf71 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.268497 Jun 07 04:47:55.545645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 64/129] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:55 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:56.085327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:56.085941 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:56.092810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.093427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.094466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.095398 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.132610 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:56.133814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:56.156480 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.158324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.163170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.164333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.473755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:56.485082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dbde508b-9664-4b03-919c-6079ba7cae61 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.402177 Jun 07 04:47:56.485774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 66/130] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:56 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:56.500034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:56.508496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-20864b74-fe95-4c32-afe5-3d30c4b836ae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.381393 Jun 07 04:47:56.518451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 65/131] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:56 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:56.560891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:56.562058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:56.569562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.570014 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.571042 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:56.571604 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:56.726249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:56.734326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-84af5b16-042a-41e2-9b4e-20ad5796d4d0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.179434 Jun 07 04:47:56.734896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 67/132] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:56 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:57.502200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:57.503271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:57.514649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.516291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.517874 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.521281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.531836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:57.533433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:57.542038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.542528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.543303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.543740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.581008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:57.766602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:57.776263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a515e02c-7e8f-4058-be8a-322a5a789e82 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.278431 Jun 07 04:47:57.777446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 66/133] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:57 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:57.782497 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:57.783882 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:57.790530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.791338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.792341 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:57.792979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:57.797864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:57.805581 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b0b36f68-5bd9-45f0-a465-a7721bc2c04e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.281867 Jun 07 04:47:57.806884 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 68/134] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:57 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:57.949579 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:57.959369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-88894d8f-9f01-42f1-9fe1-50e02992ce65 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.180325 Jun 07 04:47:57.960994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 67/135] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:57 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:58.794203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:58.794817 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:58.796726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=77 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:58.802273 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:58.802920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:58.803687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:58.804117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:58.822780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:58.824161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:58.829948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=72 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:47:58.831662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:58.832956 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:58.834371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:58.835125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:59.012309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:59.025316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-18c789b8-e8f1-42c7-bcd8-7b5ae25f3d5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.235790 Jun 07 04:47:59.026842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 69/136] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:58 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:59.040718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:47:59.042307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:47:59.049355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:59.050179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:59.051264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:59.051884 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:47:59.071749 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:59.083861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4bbab023-819c-424e-a863-9552c2e42298 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.264465 Jun 07 04:47:59.084489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 68/137] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:58 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:47:59.235894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:47:59.250728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-091fd6cc-896d-4bf1-9145-a2f4c0ae5092 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1314 microversion: 2.1 time: 0.213420 Jun 07 04:47:59.261835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:47:59 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:47:59.977146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-e61c477c-1b77-41fd-bb1f-28993440b477 req-7b94b949-78a1-473b-8123-abaa54d8e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fa9ff3-99a4-41d3-8492-a3a240d6d73e", "name": "network-vif-plugged", "status": "completed", "tag": "db28e18b-ffdc-4a2e-84c0-e448e43554aa"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:47:59.996418 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-e61c477c-1b77-41fd-bb1f-28993440b477 req-7b94b949-78a1-473b-8123-abaa54d8e4ba service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:47:59.997620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-e61c477c-1b77-41fd-bb1f-28993440b477 req-7b94b949-78a1-473b-8123-abaa54d8e4ba service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.013463 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-e61c477c-1b77-41fd-bb1f-28993440b477 req-7b94b949-78a1-473b-8123-abaa54d8e4ba service nova] Creating event network-vif-plugged:db28e18b-ffdc-4a2e-84c0-e448e43554aa for instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e on hv-cinder-83699 Jun 07 04:48:00.022628 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-e61c477c-1b77-41fd-bb1f-28993440b477 req-7b94b949-78a1-473b-8123-abaa54d8e4ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050272 Jun 07 04:48:00.025534 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 69/139] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:00.044969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:00.045687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:00.052300 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.052958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.053779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.054588 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.103070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:00.104002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:00.112233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.112682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.113485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.113911 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.349808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:00.359454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0677f925-381d-4db1-8f96-cec648662704 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.319493 Jun 07 04:48:00.360459 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 71/140] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:00 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:00.369969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:00.371039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:00.378946 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.379671 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.383291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:00.384151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:00.426106 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:00.440757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-586573cb-e9c4-4052-80d1-51f49218b0a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.340518 Jun 07 04:48:00.442112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 70/141] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:00 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:00.608997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:00.616954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bc50fb48-6ac9-47f7-bd81-0194520d1765 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1501 microversion: 2.1 time: 0.254896 Jun 07 04:48:00.617566 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 72/142] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:00 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:01.378617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:01.380878 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:01.389541 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:01.390275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:01.391156 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:01.391663 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:01.459878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:01.460567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:01.469183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:01.469889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:01.470676 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:01.471135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:01.591961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:01.599536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bd47e9f8-5de0-4ccd-b6e1-440c76385420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.225056 Jun 07 04:48:01.600115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 71/143] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:01 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:01.637067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:01.644542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d6cbdb57-88e7-41a9-8365-463a68a21aea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.189291 Jun 07 04:48:01.645112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 73/144] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:01 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:02.615988 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:02.616931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:02.623713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:02.624407 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:02.625263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:02.626163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:02.661636 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:02.662250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:02.668775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:02.669243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:02.670032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:02.670461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:02.886363 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:02.889747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:02.896643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5640432b-8832-4456-940b-dd10b48fb115 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.284399 Jun 07 04:48:02.897240 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2e5499b9-7758-4d76-8695-b7efd4fbab70 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.239424 Jun 07 04:48:02.897475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 72/145] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:02 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:02.908025 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 74/146] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:02 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:03.914235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:03.914944 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:03.921762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:03.922289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:03.923350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:03.923859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:03.924828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:03.925470 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:03.931926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:03.932386 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:03.933470 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:03.933916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:04.124835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:04.131913 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:04.133265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0cbc059d-65de-4dd1-8ac2-8b8b261c4106 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.222829 Jun 07 04:48:04.133921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 73/147] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:03 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:04.151726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f35f3ce2-50b8-4fac-b6f5-8dfe7d578ec9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.230525 Jun 07 04:48:04.152450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 75/148] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:03 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:05.152118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:05.152702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:05.161549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:05.162866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:05.164268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:05.168094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:05.168254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:05.169198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:05.180287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:05.180749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:05.182404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:05.182651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:05.520281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:05.532528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9ed7c7b8-59d7-495d-a260-cdce2b0ecc0b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.385169 Jun 07 04:48:05.535350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 74/149] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:05 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:05.574150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:05.612878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8838a189-2125-4fd8-a865-621e64b47352 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1321 microversion: 2.1 time: 0.446595 Jun 07 04:48:05.613593 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 76/150] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:05 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:06.463730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0afdecf-0b1c-4521-a06c-8e2f6e92abc1"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:06.465566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:06.477525 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.478018 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:06.478849 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.483223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:06.552921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:06.554307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:06.563303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.568369 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:06.569616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.570316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:06.860501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:06.874703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8e45ffb0-e3cd-47d1-8b5a-75faac77c2df tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1363 microversion: 2.1 time: 0.325534 Jun 07 04:48:06.877101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 77/151] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:06 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:06.883013 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:06.883860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:06.890760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.891509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:06.892533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:06.893317 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.116180 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:07.125919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b770c784-46b2-46d9-9b47-b82c7ce9a601 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1514 microversion: 2.1 time: 0.246993 Jun 07 04:48:07.130607 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 78/152] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:06 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:07.146903 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:07.152741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:07.165692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.166923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.167799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.175184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.288973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lazy-loading 'flavor' on Instance uuid 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:48:07.481803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bc185db9-227e-4844-86fc-83254443d3a9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5/action" status: 200 len: 32 microversion: 2.1 time: 0.338681 Jun 07 04:48:07.483217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 79/153] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:48:07 2022] POST /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:48:07.493373 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:07.494346 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:07.504763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.505442 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.506532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.507117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.814486 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:07.828166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5b89b084-cbb9-4985-9094-95d1dd08fad8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.339421 Jun 07 04:48:07.829121 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 80/154] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:07 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:07.907804 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:07.908930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:07.945400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.945734 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:07.971879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:07.972459 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:08.526981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fae31535-418a-4a1a-8841-5b7832626e69 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "POST /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.067316 Jun 07 04:48:08.534151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 75/155] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:48:06 2022] POST /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797/os-volume_attachments => generated 194 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:48:08.536660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:08.549603 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-11df6624-0bc0-4a07-a519-0c7b230ca872 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1548 microversion: 2.1 time: 0.653784 Jun 07 04:48:08.552533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 81/156] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:07 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1548 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:08.569572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:08.570292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:08.591058 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:08.594962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:08.598270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:08.600415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:08.847063 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:08.848192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:08.862393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:08.862875 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:08.863653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:08.864082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:09.039599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-58d32292-8d13-4dfe-a75d-e3bd3206ef1a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.474401 Jun 07 04:48:09.040200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 76/157] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 04:48:08 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-interface => generated 284 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:10.004354 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:10.015673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e85c3b39-9dec-430b-a2c3-8383370370ba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 1.172578 Jun 07 04:48:10.019786 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 82/158] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:08 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:11.035789 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:11.036992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:11.051025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:11.051833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:11.052758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:11.061744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:11.547520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:11.559511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-09738ebd-0326-456c-99a8-745d620b5a62 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.527683 Jun 07 04:48:11.560142 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 77/159] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:11 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:12.471886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-e307854f-41dd-405a-841f-34c0daa6b3dd req-2986d491-2757-4c0b-a517-621c016db9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fa9ff3-99a4-41d3-8492-a3a240d6d73e", "tag": "db28e18b-ffdc-4a2e-84c0-e448e43554aa"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:12.496524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e307854f-41dd-405a-841f-34c0daa6b3dd req-2986d491-2757-4c0b-a517-621c016db9d6 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:12.496524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e307854f-41dd-405a-841f-34c0daa6b3dd req-2986d491-2757-4c0b-a517-621c016db9d6 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:12.540082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:12.549402 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-e307854f-41dd-405a-841f-34c0daa6b3dd req-2986d491-2757-4c0b-a517-621c016db9d6 service nova] Creating event network-changed:db28e18b-ffdc-4a2e-84c0-e448e43554aa for instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e on hv-cinder-83699 Jun 07 04:48:12.560377 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-e307854f-41dd-405a-841f-34c0daa6b3dd req-2986d491-2757-4c0b-a517-621c016db9d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092189 Jun 07 04:48:12.565714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 83/160] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:12.578338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:12.579201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:12.595245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:12.596170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:12.601556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:12.604320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:12.977743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:12.998304 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-83b299d5-a311-416d-8f0c-404350f963ab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.423821 Jun 07 04:48:12.999348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 78/161] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:12 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:14.017804 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:14.018580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:14.055428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:14.056766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:14.057699 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:14.063411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:14.615058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:14.627363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d637f330-4835-464d-953d-bba4c28e2cdf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.614300 Jun 07 04:48:14.628239 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:14 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:15.646445 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:15.647663 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:15.662418 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:15.663116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:15.665063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:15.666299 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:15.926166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:15.939113 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0059b49d-0f8c-4eaf-a7be-c9e1f5467977 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.296898 Jun 07 04:48:15.940161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 79/163] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:15 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:16.956060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:16.956673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:16.964624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:16.965457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:16.966497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:16.967147 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:17.254573 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:17.284806 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4dd96c9c-b0ce-485a-acad-e3e0a84bc83b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.331535 Jun 07 04:48:17.297988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 85/164] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:16 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:17.502554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-53543ed5-2f60-4e23-90e4-691d769b6dcd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Action: 'create', calling method: .version_select at 0x7f3d5e8a7af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1404641648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAfLyxYcto5zTqpCOnFPq5QosEGEcbndDIpxQCcIWB9QiBR1mkHH0ehx8jb178NxxAg7Kvl4fwnms6PBk8DDI93w9pwo0wIQGLK+RhyvEGm1cgx080j+3F62FB8DCaTOw=="}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:17.526794 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-53543ed5-2f60-4e23-90e4-691d769b6dcd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for project 5e03f0a90584400b80b912510f02a228. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:48:17.534300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-53543ed5-2f60-4e23-90e4-691d769b6dcd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for user c4a16db9150f433e9b40545a7e68f2c5 and project 5e03f0a90584400b80b912510f02a228. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:48:17.593711 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-53543ed5-2f60-4e23-90e4-691d769b6dcd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.345040 Jun 07 04:48:17.595048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 80/165] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:48:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:48:18.304772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:18.305471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:18.314102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:18.315766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:18.319312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:18.319954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:18.654828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:18.668391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-425a45b5-1d5c-4ea5-a939-9c5a288a08f3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.368212 Jun 07 04:48:18.680472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 86/166] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:18 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:19.070370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:19.072265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:19.086075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.091555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.092552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.093081 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.103643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:19.170877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:48:19.377381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bdfa596f-3d6d-4b26-8363-0f0fdee8147e tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 204 len: 0 microversion: 2.1 time: 0.310479 Jun 07 04:48:19.381421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 81/167] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:48:19 2022] DELETE /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:48:19.387526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:19.388266 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:19.421199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.426966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.431979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.436524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.691033 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:19.692742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:19.714815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.716151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.719722 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:19.720346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:19.726077 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:19.736920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1ef8ad2c-c398-4153-a4f9-d463da167aea tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1553 microversion: 2.1 time: 0.353360 Jun 07 04:48:19.741565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 87/168] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:19 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:19.976275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:19.988044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e01d7a1f-ef5f-4dc6-8511-5899cc0fb0ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.303726 Jun 07 04:48:19.989260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 82/169] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:19 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:20.219541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438445320", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "networks": [{"uuid": "dd46282e-98fe-45b5-8357-5089b7a8e333"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:20.297718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] validate_networks() for [('dd46282e-98fe-45b5-8357-5089b7a8e333', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:48:20.756493 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:20.758054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:20.762081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:48:20.762552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:48:20.763127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:48:20.763559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:48:20.764079 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:48:20.769076 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:20.769772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:20.770728 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:20.771544 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:20.785032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:20.785032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:20.785032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:20.785032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:20.816409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Getting quotas for project 733fa1d115c146b2b465a3da17ad3897. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:48:20.816409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Getting quotas for user 4e752d2f1f3244349ba9366acfab8e41 and project 733fa1d115c146b2b465a3da17ad3897. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:48:20.827426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:48:20.830091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:48:20.907362 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-997dcbfb-5942-4b51-9ff9-9f8727ed69fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690830 Jun 07 04:48:20.911132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 88/170] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:48:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:48:20.922860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-789f9373-c755-4ae1-b249-6bee19279639 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:20.923827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-789f9373-c755-4ae1-b249-6bee19279639 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:20.963803 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:20.976027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4832678c-d8aa-4822-acfd-39b61352fcb3 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1553 microversion: 2.1 time: 0.224897 Jun 07 04:48:20.976652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 83/171] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:20 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:21.007875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:21.008605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:21.021319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:21.022434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:21.023599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:21.024187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:21.040019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-789f9373-c755-4ae1-b249-6bee19279639 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:21.059086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-789f9373-c755-4ae1-b249-6bee19279639 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1214 microversion: 2.1 time: 0.140617 Jun 07 04:48:21.070465 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 89/172] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:20 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:21.228837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:21.243284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b80129a6-499c-4a0e-8df5-78f7d076aab3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.240168 Jun 07 04:48:21.245700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 84/173] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:21 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:21.995101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:21.996435 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:22.003832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.004278 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.005048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.005575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.076395 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:22.077021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:22.092220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.092680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.093708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.094338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.283851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:22.296554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-43b755df-5911-4ddd-a614-4d9c172296fe tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1266 microversion: 2.1 time: 0.220863 Jun 07 04:48:22.297395 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 85/174] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:22 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:22.307865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:22.312390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:22.323485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.323992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.324895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:22.327649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:22.390227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:22.398108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-597982a3-261b-4a8a-9833-e209370b7da0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1553 microversion: 2.1 time: 0.407934 Jun 07 04:48:22.400288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 90/175] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:21 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1553 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:22.572746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:22.583714 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-14065ee7-d7b6-46aa-ba27-f3735910a023 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.284183 Jun 07 04:48:22.591963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 86/176] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:22 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:23.315914 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:23.318580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:23.337271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.342988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.344982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.345664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.419512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:23.419512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:23.448334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.448811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.451740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.456135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.556103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:23.576832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b35bb7fe-16cb-45ce-8aa1-4f507325df57 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1272 microversion: 2.1 time: 0.260196 Jun 07 04:48:23.583086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 91/177] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:23 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:23.612773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-56f68c31-98b6-4ad3-9920-f11cdab39843 req-bbe41ec1-a47e-4a73-8b83-8135a64012c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebc0915-9fee-4e7c-8df4-20a75bfbb797", "name": "network-vif-deleted", "tag": "7c1442ce-5bc3-4c24-8c1e-33cad9e2560f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:23.658175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:23.666956 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-56f68c31-98b6-4ad3-9920-f11cdab39843 req-bbe41ec1-a47e-4a73-8b83-8135a64012c0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.667322 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-56f68c31-98b6-4ad3-9920-f11cdab39843 req-bbe41ec1-a47e-4a73-8b83-8135a64012c0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.671173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-03fa2598-0750-43e5-8430-2c2466d81c99 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1511 microversion: 2.1 time: 0.257052 Jun 07 04:48:23.673948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 87/178] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:23 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:23.687371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:23.688099 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:23.702069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.704458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.705398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:23.706976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:23.738202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-56f68c31-98b6-4ad3-9920-f11cdab39843 req-bbe41ec1-a47e-4a73-8b83-8135a64012c0 service nova] Creating event network-vif-deleted:7c1442ce-5bc3-4c24-8c1e-33cad9e2560f for instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 on hv-cinder-83699 Jun 07 04:48:23.769822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-56f68c31-98b6-4ad3-9920-f11cdab39843 req-bbe41ec1-a47e-4a73-8b83-8135a64012c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184282 Jun 07 04:48:23.775511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 92/179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:24.154125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:24.162831 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-60cf5edf-f955-4139-8959-df1eb704a302 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.487525 Jun 07 04:48:24.167692 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 88/180] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:23 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:24.597768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:24.598587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:24.614427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:24.616391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:24.620280 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:24.622758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:24.693843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:24.695060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:24.706807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:24.709038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:24.710006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:24.712696 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:24.770682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:24.778159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:24.778979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lazy-loading 'fault' on Instance uuid aebc0915-9fee-4e7c-8df4-20a75bfbb797 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:48:24.835675 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:24.845355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4632255d-6e1c-4864-b306-0913415d0384 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.252098 Jun 07 04:48:24.846593 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 93/181] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:24 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:24.897038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6d1211ed76450ab273cf274a0f7f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e3dee338084a54a35d5798f4d5029d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:24.911574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f5225131-c02d-4ae2-bad7-e6505e4006c0 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 200 len: 1350 microversion: 2.1 time: 0.222964 Jun 07 04:48:24.912112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 89/182] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:24 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 1350 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:25.183775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:25.184508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:25.198960 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.199612 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.200536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.201155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.478515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:25.493980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-300b25dd-aae1-47d3-b8ae-63a956123f19 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.314412 Jun 07 04:48:25.495259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 94/183] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:25 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:25.863644 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:25.864880 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:25.871517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.871965 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.872755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.873397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.932483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:25.933204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:25.940864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.941047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.942233 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:25.942890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:25.965143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] HTTP exception thrown: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Request method failure captured: Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 HTTP/1.1 Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthCUD8XmNKLpIs_J9dSUZtmp9u2ozYFcMutCz7mUjBLZamPRFrTRDIhEiZmJcGe3T3FRcFW_m-2lJgfg8qNw8Lgq79cE7ao9_7b84kNeS2IOrKhtsKiiTm1s7DfxQryfDR1NZIltH6UrqDG8IFfK7s-hMchT9b7nh0qwq0OFEyfWtA Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:25.975871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}] Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: dd6d1211ed76450ab273cf274a0f7f02 Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:25.977441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'aebc0915-9fee-4e7c-8df4-20a75bfbb797'} Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:25.979638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:25.980979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:25.984219 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Returning 404 to user: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:25.985314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ba32a681-d20d-4dcb-84e8-4d58a4e31919 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 404 len: 111 microversion: 2.1 time: 0.057512 Jun 07 04:48:25.986388 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 95/184] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:25 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:26.001718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-c6d3ddd2-9bb4-4884-936e-229fd89f93dd req-8e8da675-94fb-4487-a0e1-aef2f015f7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f", "tag": "bb560410-f9d5-4cb8-831a-728d64b6815f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:26.021487 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c6d3ddd2-9bb4-4884-936e-229fd89f93dd req-8e8da675-94fb-4487-a0e1-aef2f015f7d0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:26.023325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c6d3ddd2-9bb4-4884-936e-229fd89f93dd req-8e8da675-94fb-4487-a0e1-aef2f015f7d0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:26.035190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:26.041946 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-c6d3ddd2-9bb4-4884-936e-229fd89f93dd req-8e8da675-94fb-4487-a0e1-aef2f015f7d0 service nova] Creating event network-changed:bb560410-f9d5-4cb8-831a-728d64b6815f for instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f on hv-cinder-83699 Jun 07 04:48:26.046231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-48c8215d-77f0-431b-81a9-af3d8db90fcd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.185886 Jun 07 04:48:26.048619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 90/185] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:25 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:26.066067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-c6d3ddd2-9bb4-4884-936e-229fd89f93dd req-8e8da675-94fb-4487-a0e1-aef2f015f7d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072830 Jun 07 04:48:26.066067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 96/186] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:26.145416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:26.146510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:26.152735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:26.153294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:26.154140 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:26.154658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:26.168929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] HTTP exception thrown: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Request method failure captured: Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797/os-volume_attachments HTTP/1.1 Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthCUD8XmNKLpIs_J9dSUZtmp9u2ozYFcMutCz7mUjBLZamPRFrTRDIhEiZmJcGe3T3FRcFW_m-2lJgfg8qNw8Lgq79cE7ao9_7b84kNeS2IOrKhtsKiiTm1s7DfxQryfDR1NZIltH6UrqDG8IFfK7s-hMchT9b7nh0qwq0OFEyfWtA Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:48:26.174400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}] Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: dd6d1211ed76450ab273cf274a0f7f02 Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:26.176118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'server_id': 'aebc0915-9fee-4e7c-8df4-20a75bfbb797'} Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:26.176929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:26.178333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:26.179812 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Returning 404 to user: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:26.181169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b7c04540-5beb-41fd-9feb-d00ce30c708c tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039357 Jun 07 04:48:26.182075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 91/187] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:48:26 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:26.516453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:26.517163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:26.525844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:26.526859 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:26.528129 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:26.529729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:26.706631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:26.715213 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fa1175fa-0766-45bb-8960-169ed2ffcb48 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.204235 Jun 07 04:48:26.716094 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 97/188] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:26 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:27.064382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:27.065140 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:27.075836 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.076296 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.077063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.077518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.224499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:27.233023 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6b37d8cd-c70c-4367-a029-28ae54999943 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.173014 Jun 07 04:48:27.233634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 92/189] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:27 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:27.424224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:27.425660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:27.430869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.431376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.432203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.432702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.445643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] HTTP exception thrown: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Request method failure captured: Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 HTTP/1.1 Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthCUD8XmNKLpIs_J9dSUZtmp9u2ozYFcMutCz7mUjBLZamPRFrTRDIhEiZmJcGe3T3FRcFW_m-2lJgfg8qNw8Lgq79cE7ao9_7b84kNeS2IOrKhtsKiiTm1s7DfxQryfDR1NZIltH6UrqDG8IFfK7s-hMchT9b7nh0qwq0OFEyfWtA Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:27.447762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}] Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: dd6d1211ed76450ab273cf274a0f7f02 Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.449262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'aebc0915-9fee-4e7c-8df4-20a75bfbb797'} Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:27.452992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.454254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.455610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Returning 404 to user: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:27.455610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e917ea2d-bd20-4b59-8961-06a73387e658 tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 404 len: 111 microversion: 2.1 time: 0.028872 Jun 07 04:48:27.455610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 98/190] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:48:27 2022] DELETE /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:27.457851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:27.461048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] [instance: aebc0915-9fee-4e7c-8df4-20a75bfbb797] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:27.476192 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.477016 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.478933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.479664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.505483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] HTTP exception thrown: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Request method failure captured: Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 HTTP/1.1 Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthCUD8XmNKLpIs_J9dSUZtmp9u2ozYFcMutCz7mUjBLZamPRFrTRDIhEiZmJcGe3T3FRcFW_m-2lJgfg8qNw8Lgq79cE7ao9_7b84kNeS2IOrKhtsKiiTm1s7DfxQryfDR1NZIltH6UrqDG8IFfK7s-hMchT9b7nh0qwq0OFEyfWtA Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:48:27.508057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3e3dee338084a54a35d5798f4d5029d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3e3dee338084a54a35d5798f4d5029d"}]}] Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: e3e3dee338084a54a35d5798f4d5029d Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-DeleteServersTestJSON-159839388 Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: dd6d1211ed76450ab273cf274a0f7f02 Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-DeleteServersTestJSON-159839388-project Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.510470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'aebc0915-9fee-4e7c-8df4-20a75bfbb797'} Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:27.511298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. Jun 07 04:48:27.512623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:27.513872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] Returning 404 to user: Instance aebc0915-9fee-4e7c-8df4-20a75bfbb797 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:27.513872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-000aa20b-a790-4b00-adbb-7f36590270fb tempest-DeleteServersTestJSON-159839388 tempest-DeleteServersTestJSON-159839388-project] 10.222.0.40 "GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797" status: 404 len: 111 microversion: 2.1 time: 0.056293 Jun 07 04:48:27.513872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:27 2022] GET /compute/v2.1/servers/aebc0915-9fee-4e7c-8df4-20a75bfbb797 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:27.734840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:27.735414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:27.749921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.753745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:27.754684 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:27.755253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:28.032279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:28.043650 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4ae487d6-a530-452d-a676-83ecf9d9afae tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.315505 Jun 07 04:48:28.045021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 99/192] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:27 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:28.250790 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:28.252019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:28.254681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=4 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:28.263630 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:28.264555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:28.265846 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:28.266953 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:28.477576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:28.487836 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-53d4bdff-4893-4d5e-a2db-af431640b8bd tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.241357 Jun 07 04:48:28.488862 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 94/193] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:28 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:29.061288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:29.062515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:29.065518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:29.072292 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:29.073394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:29.074651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:29.075266 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:29.293313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:29.301909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-aa44d692-71f7-4963-a2f5-eb8c6d658ae0 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.245449 Jun 07 04:48:29.302954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 100/194] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:29 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:29.506132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:29.507732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:29.520311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:29.523001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:29.523698 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:29.525821 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:29.526522 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:29.758070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:29.766926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-849bab20-ebe0-4c17-98a9-d97a32061592 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.264639 Jun 07 04:48:29.771173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 95/195] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:29 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:30.323985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:30.324592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:30.331011 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:30.331684 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:30.332673 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:30.333110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:30.515766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:30.526438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9f0ee44e-7162-46c9-9540-6d70c1866fcc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.209365 Jun 07 04:48:30.527020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 96/196] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:30 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:30.568036 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e4d07ac9-dc55-45bd-8283-7ba0b959e05f tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Action: 'create', calling method: .version_select at 0x7f3d5e037670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-990717834", "metadata": {"Type": "work"}}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e4d07ac9-dc55-45bd-8283-7ba0b959e05f tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 121 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:30.578765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-990717834", "metadata": {"Type": "work"}}} Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 04:48:30.580501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-990717834', 'metadata': {'Type': 'work'}}}} Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise error Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.581494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 04:48:30.583584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 04:48:30.584644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 04:48:30.584644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.584644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e4d07ac9-dc55-45bd-8283-7ba0b959e05f tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.584644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e4d07ac9-dc55-45bd-8283-7ba0b959e05f tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.334309 Jun 07 04:48:30.584644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 101/197] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Jun 7 04:48:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 04:48:30.594161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e6d31574-4e36-4c92-ab43-b8ba846df561 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Action: 'create', calling method: .version_select at 0x7f3d5e8a73a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2100241839", "metadata": {"Type": "work"}}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e6d31574-4e36-4c92-ab43-b8ba846df561 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 120 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:48:30.597434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2100241839", "metadata": {"Type": "work"}}} Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: Jun 07 04:48:30.600779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2100241839', 'metadata': {'Type': 'work'}}}} Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise error Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi '0' Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.601723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 04:48:30.603265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 04:48:30.605060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 04:48:30.605060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.605060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e6d31574-4e36-4c92-ab43-b8ba846df561 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.605060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e6d31574-4e36-4c92-ab43-b8ba846df561 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008507 Jun 07 04:48:30.605060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 97/198] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Jun 7 04:48:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e229a20d-3275-4bc5-a223-7793b5ec7dc6 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Action: 'create', calling method: .version_select at 0x7f3d5dfba9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1721202227", "metadata": {"Type": "work"}}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e229a20d-3275-4bc5-a223-7793b5ec7dc6 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 119 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:48:30.613256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1721202227", "metadata": {"Type": "work"}}} Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: Jun 07 04:48:30.614980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1721202227', 'metadata': {'Type': 'work'}}}} Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise error Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi '' Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.616026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 04:48:30.617571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 04:48:30.619922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 04:48:30.619922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.619922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e229a20d-3275-4bc5-a223-7793b5ec7dc6 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.619922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e229a20d-3275-4bc5-a223-7793b5ec7dc6 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008363 Jun 07 04:48:30.624496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-925575f3-e75b-4954-b303-7d44d5e56d0d tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Calling method '.version_select at 0x7f3d5dfa93a0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:30.625413 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 98/199] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Jun 7 04:48:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 04:48:30.657613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-925575f3-e75b-4954-b303-7d44d5e56d0d tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] HTTP exception thrown: Volume tempest-invalid-1251380211 could not be found. Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-925575f3-e75b-4954-b303-7d44d5e56d0d tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1251380211 HTTP/1.1 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:30.659605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Volume tempest-invalid-1251380211 could not be found. Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'tempest-invalid-1251380211'} Jun 07 04:48:30.660957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1251380211 could not be found. (HTTP 404) (Request-ID: req-9913180e-cfbc-400e-8d32-714f9aef0cfc) Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.661886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 04:48:30.663216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1251380211 could not be found. Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:30.664461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1251380211 could not be found. Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1251380211 could not be found. Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-925575f3-e75b-4954-b303-7d44d5e56d0d tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 404 to user: Volume tempest-invalid-1251380211 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.666371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-925575f3-e75b-4954-b303-7d44d5e56d0d tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1251380211" status: 404 len: 99 microversion: 2.1 time: 0.040280 Jun 07 04:48:30.671704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 102/200] 10.222.0.40 () {58 vars in 1217 bytes} [Tue Jun 7 04:48:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1251380211 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 04:48:30.674726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e5a91e04-6cfa-49d4-982b-3dba252be60b tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005243 Jun 07 04:48:30.674726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 99/201] 10.222.0.40 () {58 vars in 1139 bytes} [Tue Jun 7 04:48:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 04:48:30.684057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-419f458a-93f5-48fe-8031-2003d8baf446 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004555 Jun 07 04:48:30.684889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 103/202] 10.222.0.40 () {58 vars in 1136 bytes} [Tue Jun 7 04:48:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 04:48:30.696416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d0a67d6d-f297-433d-bae3-45eb896a5243 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Calling method '.version_select at 0x7f3d5dfcbaf0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:30.734913 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-d0a67d6d-f297-433d-bae3-45eb896a5243 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] HTTP exception thrown: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d0a67d6d-f297-433d-bae3-45eb896a5243 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/os-volumes/68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 HTTP/1.1 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:48:30.739990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '68e00228-32b2-49e1-a8b0-b5fe67ffd7a6'} Jun 07 04:48:30.741464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. (HTTP 404) (Request-ID: req-961210b1-8f5c-4888-a7da-bbca712bb856) Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.742225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 04:48:30.743465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 04:48:30.745074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d0a67d6d-f297-433d-bae3-45eb896a5243 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 404 to user: Volume 68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d0a67d6d-f297-433d-bae3-45eb896a5243 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/68e00228-32b2-49e1-a8b0-b5fe67ffd7a6" status: 404 len: 109 microversion: 2.1 time: 0.050581 Jun 07 04:48:30.746434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 100/203] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 04:48:30 2022] DELETE /compute/v2.1/os-volumes/68e00228-32b2-49e1-a8b0-b5fe67ffd7a6 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:30.758328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f9da6dfd-bffe-472c-a585-24d2dd4774d7 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Calling method '.version_select at 0x7f3d5de9df70>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:30.788964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:30.789803 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:30.795104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:30.798350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-f9da6dfd-bffe-472c-a585-24d2dd4774d7 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] HTTP exception thrown: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f9da6dfd-bffe-472c-a585-24d2dd4774d7 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Request method failure captured: Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/os-volumes/c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 HTTP/1.1 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintieJQ6iOSo9r-xRZvlANH507JXHspMZCTOgKUziHB6wbWZq7cGIkm0kxI94MFU2ltvchXoFaeEQKeU-ksjUpJiS9SwHu8A9q2FmC3dGmsBJEdy4lmeD_6yFmpsod5IOLdUu1ZwiZ6p5SDH90AQ0PrEkb9okL_stgU1iUO1e8s0c0Hs Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:30.800379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ca8c3de33674453bcfdcb9852cdc7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ca8c3de33674453bcfdcb9852cdc7b7"}]}] Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 2ca8c3de33674453bcfdcb9852cdc7b7 Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesNegativeTest-1411104367 Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 48ac092aee2342e6b0e18ad8d25bfae6 Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesNegativeTest-1411104367-project Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'c96cf108-2ebb-4ad1-80fc-ac2105b8cd51'} Jun 07 04:48:30.801894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. (HTTP 404) (Request-ID: req-327efb1b-4b94-4715-809a-0989756096fc) Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.803029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 04:48:30.804502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 04:48:30.806011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. Jun 07 04:48:30.807694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:30.808431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:30.808431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:30.808431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:30.808431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:30.810834 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f9da6dfd-bffe-472c-a585-24d2dd4774d7 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] Returning 404 to user: Volume c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:30.811600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f9da6dfd-bffe-472c-a585-24d2dd4774d7 tempest-VolumesNegativeTest-1411104367 tempest-VolumesNegativeTest-1411104367-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c96cf108-2ebb-4ad1-80fc-ac2105b8cd51" status: 404 len: 109 microversion: 2.1 time: 0.057075 Jun 07 04:48:30.812655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 104/204] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 04:48:30 2022] GET /compute/v2.1/os-volumes/c96cf108-2ebb-4ad1-80fc-ac2105b8cd51 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:30.821862 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:30.967627 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:30.981448 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8da6b3b0-491a-4679-955f-e99c590617e8 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.196144 Jun 07 04:48:30.982531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 101/205] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:30 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:31.540578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=8 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:31.547260 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:31.548419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:31.557089 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:31.557811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:31.558778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:31.559514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:31.734440 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:31.744225 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8f133250-16fe-4fd1-96fb-3c3d3be32e8b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.204342 Jun 07 04:48:31.744800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 105/206] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:31 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:32.000535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:32.001159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:32.009828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:32.010498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:32.011539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:32.012069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:32.238826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-c0f27de0-78c2-468a-b54b-716d400a7bb2 req-e464dc0c-42d4-4caa-ad3b-9d3899ec360d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f", "name": "network-vif-plugged", "status": "completed", "tag": "bb560410-f9d5-4cb8-831a-728d64b6815f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:32.251936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:32.254397 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c0f27de0-78c2-468a-b54b-716d400a7bb2 req-e464dc0c-42d4-4caa-ad3b-9d3899ec360d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:32.255029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c0f27de0-78c2-468a-b54b-716d400a7bb2 req-e464dc0c-42d4-4caa-ad3b-9d3899ec360d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:32.262181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3e64468b-7a28-4580-bb51-f39f47d4da8a tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.266030 Jun 07 04:48:32.263187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 102/207] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:31 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:32.297407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-c0f27de0-78c2-468a-b54b-716d400a7bb2 req-e464dc0c-42d4-4caa-ad3b-9d3899ec360d service nova] Creating event network-vif-plugged:bb560410-f9d5-4cb8-831a-728d64b6815f for instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f on hv-cinder-83699 Jun 07 04:48:32.306860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-c0f27de0-78c2-468a-b54b-716d400a7bb2 req-e464dc0c-42d4-4caa-ad3b-9d3899ec360d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071715 Jun 07 04:48:32.308905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 106/208] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:48:32.763671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:32.764764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:32.772160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:32.772801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:32.773795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:32.774862 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:33.000509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:33.009745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a9708f69-bcf7-48ce-889d-de1cdd1d1acb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.251983 Jun 07 04:48:33.011068 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 103/209] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:32 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:33.280211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:33.280911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:33.287520 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:33.287974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:33.288745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:33.289184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:33.467956 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:33.488380 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-52164782-9b8c-4161-b0f8-b4a5e28b0920 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.212266 Jun 07 04:48:33.489678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 107/210] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:33 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:34.028025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:34.034238 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:34.042529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:34.043353 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:34.044623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:34.045324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:34.229694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:34.246245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ab33eb70-edd8-4185-91f6-1838ada95a55 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.221987 Jun 07 04:48:34.246826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 104/211] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:34 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:34.506977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:34.507584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:34.514908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:34.515754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:34.516704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:34.517368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:34.700193 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:34.707840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3e287577-e946-4a28-9075-cf2397edcb09 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1314 microversion: 2.1 time: 0.204615 Jun 07 04:48:34.708414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:34 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:35.266627 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:35.267264 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:35.273933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:35.274385 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:35.275538 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:35.275971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:35.468552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:35.476863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-37c2fc88-981c-44b4-8b83-2095b6fbce10 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.216010 Jun 07 04:48:35.478031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 105/213] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:35 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:35.729462 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:35.730072 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:35.737498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:35.737951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:35.738741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:35.739173 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:35.757984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:35.878168 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:35.885919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-883341ba-0635-4fd9-adc9-ce3ad925cd51 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1499 microversion: 2.1 time: 0.162459 Jun 07 04:48:35.897422 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 109/214] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:35 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:36.457857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:36.459177 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:36.467605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.468061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.472145 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.472708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.501778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:36.502764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:36.505595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:48:36.512444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.513133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.514355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.515024 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.606649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-912f8457-72f4-44e0-9cf9-d2fc59089e74 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 204 len: 0 microversion: 2.1 time: 0.152946 Jun 07 04:48:36.607612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 106/215] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:48:36 2022] DELETE /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:48:36.616129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:36.616918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:36.623717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.624305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.625497 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:36.625996 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:36.935016 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:36.944655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4d1155f3-8f20-4fe7-b5df-28047ed80cb1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.452694 Jun 07 04:48:36.945499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 110/216] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:36 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:36.991490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:37.000795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-73aa9168-e2fe-4e05-a58d-f184a26df8c1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1505 microversion: 2.1 time: 0.388839 Jun 07 04:48:37.001393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 107/217] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:36 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:37.962309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:37.962815 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:37.968813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:37.969303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:37.970117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:37.970557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:38.018868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:38.019491 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:38.025960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:38.026415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:38.027191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:38.027631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:38.141461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:38.150197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8931cee0-98c8-451a-a59e-5b37d9055db9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.191838 Jun 07 04:48:38.150781 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 111/218] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:37 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:38.186137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:38.193665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2cd1e9be-ad0e-47e9-8753-0252b7e01fb6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1505 microversion: 2.1 time: 0.178679 Jun 07 04:48:38.194235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 108/219] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:38 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:39.040677 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-692bba07-ba4f-4dab-806c-79634ef714a1 req-d326e36e-8282-400b-ba43-650bd0484d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f", "name": "network-vif-deleted", "tag": "bb560410-f9d5-4cb8-831a-728d64b6815f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:39.050268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-692bba07-ba4f-4dab-806c-79634ef714a1 req-d326e36e-8282-400b-ba43-650bd0484d6a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.050714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-692bba07-ba4f-4dab-806c-79634ef714a1 req-d326e36e-8282-400b-ba43-650bd0484d6a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.063171 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-692bba07-ba4f-4dab-806c-79634ef714a1 req-d326e36e-8282-400b-ba43-650bd0484d6a service nova] Creating event network-vif-deleted:bb560410-f9d5-4cb8-831a-728d64b6815f for instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f on hv-cinder-83699 Jun 07 04:48:39.068000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-692bba07-ba4f-4dab-806c-79634ef714a1 req-d326e36e-8282-400b-ba43-650bd0484d6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Jun 07 04:48:39.068594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 112/220] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:39.167075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:39.167685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:39.174271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.174724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.175489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.176111 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.212574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:39.213452 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:39.220918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.221428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.222270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.222707 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.285953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:39.287346 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:39.288568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lazy-loading 'fault' on Instance uuid 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:48:39.343378 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:39.352562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-10640275-dbf3-49d9-b8e5-43189788c082 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 200 len: 1304 microversion: 2.1 time: 0.144150 Jun 07 04:48:39.353491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 113/221] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:39 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:39.365086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:39.373103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c6a51bf6-0165-4fd8-8db5-b07717155951 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.210302 Jun 07 04:48:39.373655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 109/222] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:39 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:40.370112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:40.370724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:40.377114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:40.377592 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:40.378393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:40.378808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:40.390113 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:40.391036 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:40.392673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] HTTP exception thrown: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Request method failure captured: Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f HTTP/1.1 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintiRQfzPfVJuaISQx_XRDd8-uyvI6Cyo9eh7jNDIXM2z8GCItqV7N5UBBrQthf9R0mDClkL5rbnJ7TapbhSMUirfBl57WuAR99wmljlZsAFsGdDFIQTxCnan05iya5LUI6Z-_LP_GbkrwNO_nGHKyCYa2UvQpvcxitVUAA_os985Ogk Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 733fa1d115c146b2b465a3da17ad3897 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesActionsTest-363334125 Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:48:40.394348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/733fa1d115c146b2b465a3da17ad3897"}]}] Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesActionsTest-363334125 Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 733fa1d115c146b2b465a3da17ad3897 Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesActionsTest-363334125 Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesActionsTest-363334125-project Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 4e752d2f1f3244349ba9366acfab8e41 Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesActionsTest-363334125-project Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. Jun 07 04:48:40.395761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f'} Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:48:40.396714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. Jun 07 04:48:40.398255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:48:40.400541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Returning 404 to user: Instance 8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:48:40.400541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f4382d0e-9e8f-4a4a-bb75-0093cffc5fda tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f" status: 404 len: 111 microversion: 2.1 time: 0.029782 Jun 07 04:48:40.400541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 114/223] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:40 2022] GET /compute/v2.1/servers/8358fb81-eabc-4e5a-aeb4-ec5b8780ef8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:48:40.400738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:40.400738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:40.400738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:40.400738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:40.511539 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1084335531", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "networks": [{"uuid": "dd46282e-98fe-45b5-8357-5089b7a8e333"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:40.540938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:40.549930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3553400c-de79-4f30-9b2a-3bc8dc6dc926 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.163453 Jun 07 04:48:40.550977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 110/224] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:40 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:41.567205 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:41.567897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:41.574202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:41.574648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:41.575399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:41.575827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:41.716742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:41.724641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-eee36d80-bca6-41d0-b8a9-a2efe9402dea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.161073 Jun 07 04:48:41.725367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 111/225] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:41 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:42.742288 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:42.743784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:42.750251 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:42.750694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:42.751456 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:42.751884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:42.889080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:42.899462 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-82c0ed9a-b60b-42ad-ad5d-fa0211830575 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.160307 Jun 07 04:48:42.900678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 112/226] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:42 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:43.033347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] validate_networks() for [('dd46282e-98fe-45b5-8357-5089b7a8e333', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:48:43.373390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:48:43.373910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:48:43.374281 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:48:43.374690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:48:43.375367 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:48:43.384740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:43.385186 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:43.386031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:43.386468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:43.403692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Getting quotas for project 733fa1d115c146b2b465a3da17ad3897. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:48:43.407908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Getting quotas for user 4e752d2f1f3244349ba9366acfab8e41 and project 733fa1d115c146b2b465a3da17ad3897. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:48:43.418973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:48:43.421249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:48:43.467003 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7172be47-4dff-482b-a00b-7bfe84230efc tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.959492 Jun 07 04:48:43.468038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 115/227] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:48:43.478832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-eabb801f-c13c-4ca9-b98d-96d009bbfda4 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:43.479702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-eabb801f-c13c-4ca9-b98d-96d009bbfda4 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:43.541886 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-eabb801f-c13c-4ca9-b98d-96d009bbfda4 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:43.548493 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-eabb801f-c13c-4ca9-b98d-96d009bbfda4 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1214 microversion: 2.1 time: 0.074210 Jun 07 04:48:43.553606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 113/228] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:43 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:43.918832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:43.919471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:43.926238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:43.926688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:43.927453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:43.927898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:44.063949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:44.071940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-80a19a67-56cd-4b91-8e7c-cfe7386eb9be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.157543 Jun 07 04:48:44.072537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 116/229] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:43 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:44.566716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:44.567335 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:44.574408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:44.575245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:44.576018 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:44.576453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:44.641060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:44.649685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8ed03410-3a4f-4c80-8598-99db28d2ff02 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.086620 Jun 07 04:48:44.650266 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 114/230] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:44 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:45.093518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:45.094140 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:45.101017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:45.101584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:45.102769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:45.103232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:45.247838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:45.255769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-80339457-3a8d-4ad7-b581-ace9575b2962 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.166772 Jun 07 04:48:45.256341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 117/231] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:45 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:45.666890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:45.667507 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:45.674161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:45.674609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:45.675379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:45.675816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:45.740044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:45.747750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0eae0f5d-016d-4459-a418-0ced2f787284 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.085325 Jun 07 04:48:45.748315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 115/232] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:45 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:46.273555 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:46.274360 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:46.280350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:46.280805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:46.281586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:46.282024 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:46.413165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:46.420836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-799d6097-4022-4911-a0ec-2148eb204bfd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.151303 Jun 07 04:48:46.421445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 118/233] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:46 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:46.763751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:46.764353 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:46.770759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:46.771200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:46.771951 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:46.772444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:46.837563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:46.844936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7b3a058d-6a25-4191-9984-d4df5ef4ad6e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.084962 Jun 07 04:48:46.845527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 116/234] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:46 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:47.437948 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:47.438485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:47.444614 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:47.445063 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:47.446366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:47.446802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:47.573885 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:47.581311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dd2d554e-fb3a-47bc-8163-63a59cb7528f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.147224 Jun 07 04:48:47.581887 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 119/235] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:47 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:47.862617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:47.863243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:47.870186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:47.870637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:47.871399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:47.871965 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:47.877292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:47.938864 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:47.947012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-497b39fe-3673-4367-bdf7-05a58a67a531 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.088244 Jun 07 04:48:47.947539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 117/236] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:47 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:48.598611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:48.599217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:48.606680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:48.607131 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:48.607955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:48.608408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:48.736986 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:48.744533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-66325bd5-b849-4212-8499-30a40c625219 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.149764 Jun 07 04:48:48.745127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 120/237] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:48 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:48.964183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:48.964900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:48.971661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:48.972113 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:48.972876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:48.973345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:49.034983 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:49.042637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-06c959f0-882c-4ddb-a0ad-9ffda034a574 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.083121 Jun 07 04:48:49.043211 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 118/238] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:48 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:49.760755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:49.761419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:49.768014 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:49.768466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:49.769241 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:49.769689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:49.912111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:49.920309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-83f8c08e-eb7e-4217-81f2-7464a9bfe8f4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.163414 Jun 07 04:48:49.920879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 121/239] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:49 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:50.059291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:50.059946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:50.066557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:50.067013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:50.067777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:50.068222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:50.127429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:50.134786 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ca2655e8-fbd7-459f-b589-c1ce03514237 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.079334 Jun 07 04:48:50.135356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 119/240] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:50 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:50.936123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:50.936634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:50.942656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:50.943098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:50.944181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:50.944616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:51.074279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:51.081865 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-65247f1a-3e6b-4024-afbf-6f08b291ee9a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.149555 Jun 07 04:48:51.082574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 122/241] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:50 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:51.151718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:51.152334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:51.158933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:51.159381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:51.160139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:51.160574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:51.224467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:51.231918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1ca3eda0-f56a-4fd8-b330-367c16d50862 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.084625 Jun 07 04:48:51.232487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 120/242] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:51 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:52.098928 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:52.099675 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:52.107071 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:52.107640 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:52.108511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:52.109005 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:52.243059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:52.247612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:52.248219 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:52.250858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-33aefbc8-bb77-4559-92c5-db3303f311cd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.155686 Jun 07 04:48:52.251425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 123/243] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:52 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:52.255112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:52.255567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:52.256332 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:52.256766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:52.316868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:52.324741 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cc08fca2-0f17-4015-80e5-4ca64ac95004 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1218 microversion: 2.1 time: 0.080844 Jun 07 04:48:52.325381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 121/244] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:52 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:53.267641 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:53.268248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:53.274236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:53.274685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:53.275441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:53.275875 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:53.341701 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:53.342415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:53.349021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:53.349559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:53.350327 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:53.350762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:53.393954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:53.415199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:53.431510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:53.434907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:53.438996 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-13b04282-e98e-4a58-8be4-9cf8a5c95940 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1266 microversion: 2.1 time: 0.101084 Jun 07 04:48:53.439561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 122/245] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:53 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:53.442813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9571d012-c4c8-4a1b-8932-dc5f436a6702 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.178837 Jun 07 04:48:53.443544 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 124/246] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:53 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:54.456099 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:54.457416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:54.459519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:54.459996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:54.462051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:54.466702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:54.467276 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:54.468116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:54.468612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:54.469007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:54.469503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:54.470441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:54.471078 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:54.561323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:54.572088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e984ff15-3885-449a-8403-c81b50be15a1 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1274 microversion: 2.1 time: 0.119879 Jun 07 04:48:54.582833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 123/247] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:54 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:54.652276 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:54.659861 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a579d08a-560a-48a4-a0a8-29234fdf2bf6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.203960 Jun 07 04:48:54.660424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 125/248] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:54 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:48:55.591537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:55.592229 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:55.599533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:55.600085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:55.601006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:55.601701 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:55.675974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:55.676738 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:55.683965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:55.684790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:55.685851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:55.686952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:55.701791 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:55.709519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-00376547-f41c-422e-8699-1e6c4552cc26 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1272 microversion: 2.1 time: 0.122309 Jun 07 04:48:55.713286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 124/249] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:55 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:55.834204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:55.842358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3a6ac927-7dde-4a6b-a2cd-7bec361b1e51 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.170153 Jun 07 04:48:55.842827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 126/250] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:55 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:56.632895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-65d35772-5c5d-4fd0-9f18-287fd22c4b3b req-9b40f2d2-3392-4ac1-a982-24a3d8a80660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43beb8a-ec24-46e9-b287-9aa8ffb08563", "tag": "74048895-16de-4ebe-a0b5-5666faa9d16e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:48:56.644203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-65d35772-5c5d-4fd0-9f18-287fd22c4b3b req-9b40f2d2-3392-4ac1-a982-24a3d8a80660 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:56.644797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-65d35772-5c5d-4fd0-9f18-287fd22c4b3b req-9b40f2d2-3392-4ac1-a982-24a3d8a80660 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:56.659545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-65d35772-5c5d-4fd0-9f18-287fd22c4b3b req-9b40f2d2-3392-4ac1-a982-24a3d8a80660 service nova] Creating event network-changed:74048895-16de-4ebe-a0b5-5666faa9d16e for instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 on hv-cinder-83699 Jun 07 04:48:56.665215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-65d35772-5c5d-4fd0-9f18-287fd22c4b3b req-9b40f2d2-3392-4ac1-a982-24a3d8a80660 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036654 Jun 07 04:48:56.665913 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 125/251] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:48:56.728088 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:56.728825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:56.738884 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:56.739412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:56.740631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:56.741299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:56.860528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:56.861264 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:56.868560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:56.869392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:56.870383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:56.871031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:56.905682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:56.909460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:48:56.917347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0b7e4aaf-05cb-48ee-a4cd-88bb765cf1ec tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.194469 Jun 07 04:48:56.918002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 127/252] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:56 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:57.032302 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:57.040771 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b1c79e4a-156b-4873-87a6-80a3da8581ec tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1520 microversion: 2.1 time: 0.185516 Jun 07 04:48:57.041551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 126/253] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:56 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:57.933571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:57.934244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:57.940404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:57.940850 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:57.941643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:57.942076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:58.058272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:58.058905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:58.066230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:58.067178 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:58.068815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:58.070756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:58.084060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:58.093315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ffa78f08-9385-4d7a-b74e-44e13871606c tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.163712 Jun 07 04:48:58.094499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 128/254] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:57 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:58.221517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:58.235216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1ec6a17b-ec56-424e-8ed3-e869fdf9a162 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1500 microversion: 2.1 time: 0.181607 Jun 07 04:48:58.235810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 127/255] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:58 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:58.252899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:58.253733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:58.260972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:58.261487 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:58.262336 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:58.262797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:58.400155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:58.408599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dcd5b294-9c59-4180-8545-da16968d10c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1514 microversion: 2.1 time: 0.160213 Jun 07 04:48:58.409330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 129/256] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:58 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:48:59.112004 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:48:59.112612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:48:59.119502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:59.120026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:59.120717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:48:59.121147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:48:59.276130 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:48:59.284537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0f6a58c8-3d01-4569-8ce7-877259b20011 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.176241 Jun 07 04:48:59.285490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 128/257] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:48:59 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:00.303028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:00.303631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:00.306943 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:00.312594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:00.313057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:00.313858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:00.314291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:00.457342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:00.465700 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ee2d4540-62df-49d8-b3d8-0e3958d08411 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.166444 Jun 07 04:49:00.466456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 130/258] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:00 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:00.847657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:00.848789 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:00.852337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:00.857751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:00.858199 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:00.858969 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:00.859404 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:00.884148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lazy-loading 'flavor' on Instance uuid 16ac6b6c-d38b-4b7d-9200-833ed36cc465 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:49:01.008046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-94efbf41-ecc3-4813-9d36-fee51d400f25 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/action" status: 200 len: 32 microversion: 2.1 time: 0.163617 Jun 07 04:49:01.012854 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 129/259] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:49:00 2022] POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:49:01.018304 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:01.019099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:01.025509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:01.026035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:01.026896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:01.027330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:01.158752 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:01.167505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3710de28-329d-4910-b60f-cd04534ffb99 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.153331 Jun 07 04:49:01.168085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 131/260] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:01 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:01.483514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:01.484325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:01.490629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:01.491079 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:01.492273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:01.492711 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:01.627793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:01.635754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d2833970-84b8-4018-85bc-35e19fb06433 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.156487 Jun 07 04:49:01.636320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 130/261] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:01 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:02.185250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:02.185828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:02.191918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:02.192365 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:02.193127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:02.193656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:02.326857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:02.335001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c6c39960-4d7b-4461-a712-37cea690e3e6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.153888 Jun 07 04:49:02.335713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 132/262] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:02 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:02.651866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:02.652474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:02.659760 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:02.660264 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:02.661052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:02.661514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:02.800584 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:02.808359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9b91ca55-8784-4dbd-8114-838eb6971ede tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.160306 Jun 07 04:49:02.809179 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 131/263] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:02 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:03.352047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:03.352690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:03.358818 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:03.359271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:03.360041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:03.360476 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:03.569120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:03.579630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ed9a22ca-7de4-44df-972b-e87391421edb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.231452 Jun 07 04:49:03.584772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 133/264] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:03 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:03.827341 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:03.828001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:03.837660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:03.838201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:03.839176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:03.839676 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:03.859069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:03.973652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:03.981151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e87d582c-0eec-476a-9a27-80f492339f80 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.158123 Jun 07 04:49:03.981762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 132/265] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:03 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:04.599407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:04.600343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:04.607348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:04.609120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:04.609965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:04.610405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:04.747454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:04.755295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-21436892-8d97-41e9-9b8e-488666531898 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.161292 Jun 07 04:49:04.755803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 134/266] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:04 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:04.998057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:04.998662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:05.005877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:05.006319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:05.007479 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:05.008159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:05.152984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:05.161518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e7e5089f-9388-41c3-ac5c-db4282413af6 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.167143 Jun 07 04:49:05.162098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 133/267] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:04 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:05.772662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:05.774832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:05.781595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:05.782130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:05.782974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:05.783476 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:05.916719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-4f40d72b-fae7-47b6-b4f1-af33a13ac20e req-c9437651-f99d-4404-90e3-128cf2a3ce0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43beb8a-ec24-46e9-b287-9aa8ffb08563", "name": "network-vif-plugged", "status": "completed", "tag": "74048895-16de-4ebe-a0b5-5666faa9d16e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:05.927794 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4f40d72b-fae7-47b6-b4f1-af33a13ac20e req-c9437651-f99d-4404-90e3-128cf2a3ce0d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:05.928530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4f40d72b-fae7-47b6-b4f1-af33a13ac20e req-c9437651-f99d-4404-90e3-128cf2a3ce0d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:05.935302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:05.945244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d5623ba4-31fc-47dc-bfd3-11babdcedea2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.175966 Jun 07 04:49:05.945625 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-4f40d72b-fae7-47b6-b4f1-af33a13ac20e req-c9437651-f99d-4404-90e3-128cf2a3ce0d service nova] Creating event network-vif-plugged:74048895-16de-4ebe-a0b5-5666faa9d16e for instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 on hv-cinder-83699 Jun 07 04:49:05.955884 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 135/268] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:05 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:05.959007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-4f40d72b-fae7-47b6-b4f1-af33a13ac20e req-c9437651-f99d-4404-90e3-128cf2a3ce0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052375 Jun 07 04:49:05.959977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 134/269] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:49:06.179598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:06.180438 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:06.187187 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:06.187613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:06.188379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:06.188812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:06.336691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:06.344766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d4d1cbb4-b02e-4ce9-986e-5b70905b4c7e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.169657 Jun 07 04:49:06.345328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 136/270] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:06 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:06.964832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:06.965547 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:06.971624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:06.972072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:06.972941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:06.973281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:07.106027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:07.113608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-491c5137-923e-458c-bc24-50aee8bca0ac tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.154177 Jun 07 04:49:07.114178 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 135/271] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:06 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:07.362119 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:07.362641 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:07.369168 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:07.369651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:07.370416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:07.370849 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:07.501588 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:07.509477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3b3d1c3b-8265-4aa6-85a9-2fada6522988 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.151211 Jun 07 04:49:07.510041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 137/272] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:07 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:08.130372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:08.130975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:08.138416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:08.138863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:08.139609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:08.140038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:08.270348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:08.278271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e080f99c-100e-468d-a4ea-a0ffe95c5841 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.151654 Jun 07 04:49:08.278997 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 136/273] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:08 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:08.525984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:08.526596 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:08.532583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:08.533030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:08.533838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:08.534278 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:08.665080 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:08.672502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7506e349-17ff-4e1f-be93-8ae29a7d2d4b tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1314 microversion: 2.1 time: 0.150394 Jun 07 04:49:08.683446 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 138/274] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:08 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:09.294768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:09.295379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:09.301780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:09.302242 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:09.303001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:09.303431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:09.435804 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:09.443206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-429840ee-123d-4331-84fd-08208289bfe5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.152316 Jun 07 04:49:09.443762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 137/275] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:09 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:09.690802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:09.691411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:09.698247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:09.698694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:09.699455 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:09.699889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:09.833695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:09.841184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8a030425-66c7-42db-9663-6eafc5cdc94e tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1498 microversion: 2.1 time: 0.155502 Jun 07 04:49:09.842003 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 139/276] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:09 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:10.460699 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:10.461432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:10.467565 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:10.468012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:10.468767 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:10.469218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:10.602437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:10.609893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8c15fd64-8d99-4afa-bae8-4f1a41bfb96d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.153454 Jun 07 04:49:10.610487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 138/277] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:10 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:10.954568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571477613", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1404641648", "security_groups": [{"name": "tempest-secgroup-smoke-1820215520"}], "block_device_mapping_v2": [{"uuid": "de530cd6-e089-4e73-abe2-ab14d65b4138", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a9cdced-d65a-4ad0-9d69-4961d1237297"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:11.065038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] validate_networks() for [('3a9cdced-d65a-4ad0-9d69-4961d1237297', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:49:11.421344 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:49:11.421776 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:49:11.422253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:49:11.422658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:49:11.423091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:49:11.432385 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:11.432831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:11.433649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:11.434084 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:11.450944 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:49:11.454741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for user c4a16db9150f433e9b40545a7e68f2c5 and project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:49:11.511154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:49:11.513159 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de530cd6-e089-4e73-abe2-ab14d65b4138',volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:49:11.627084 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:11.627696 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:11.634334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:11.634788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:11.635768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:11.636208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:11.636414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ea1cda82-b943-45e3-a245-440099172ae1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685582 Jun 07 04:49:11.637058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 140/278] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:49:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:49:11.650367 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2c9fda1d-de54-4294-a15a-8385f63d0a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:11.650983 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2c9fda1d-de54-4294-a15a-8385f63d0a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:11.747988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2c9fda1d-de54-4294-a15a-8385f63d0a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:11.755513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2c9fda1d-de54-4294-a15a-8385f63d0a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1094 microversion: 2.1 time: 0.109148 Jun 07 04:49:11.756232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 141/279] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:11 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:11.815826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:11.824070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-58d4e6c5-3063-4c02-82d4-480a6388b87c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.200958 Jun 07 04:49:11.824920 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 139/280] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:11 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:12.776011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:12.776648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:12.783476 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:12.783922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:12.784680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:12.785105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:12.841483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:12.842545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:12.844216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:12.848742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:12.849183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:12.849985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:12.851096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:12.852065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d0a63677-c1d2-4f2e-926e-6e58d7aa766d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1144 microversion: 2.1 time: 0.080085 Jun 07 04:49:12.852640 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 142/281] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:12 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:12.984540 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:12.993818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-baed8edc-e373-452d-8174-cd0f40a86511 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.156108 Jun 07 04:49:12.994474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 140/282] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:12 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:13.869510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:13.870114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:13.876343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:13.876788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:13.877566 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:13.877996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:13.937622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:13.945746 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-44194842-31c0-4b13-b27b-efba6be50e1b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1144 microversion: 2.1 time: 0.080796 Jun 07 04:49:13.946246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 143/283] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:13 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:14.012510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:14.013124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:14.019623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:14.020074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:14.020840 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:14.021307 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:14.153292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:14.160805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-91555544-885d-4a08-bd1a-bef62515f600 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.152340 Jun 07 04:49:14.161403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 141/284] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:14 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:14.963439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:14.963972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:14.970534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:14.971056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:14.971916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:14.972416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:15.031368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:15.038519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-da11ce7c-4a74-4cb6-a1a7-e17b7fdeeb3a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1144 microversion: 2.1 time: 0.079642 Jun 07 04:49:15.039079 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 144/285] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:14 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:15.177664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:15.178284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:15.184827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:15.185375 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:15.186140 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:15.186575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:15.317089 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:15.325652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4a05354a-a1b4-44b2-a704-8d6febd01392 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.151747 Jun 07 04:49:15.334807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 142/286] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:15 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:15.972870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:15.973600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:15.980429 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:15.980803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:15.981619 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:15.982053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.012052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:49:16.026297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:16.057254 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:16.058404 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:16.064592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.065047 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.065850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.066283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.105150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d35662be-92c6-451b-a01d-e1a6a8757bc7 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 204 len: 0 microversion: 2.1 time: 0.135877 Jun 07 04:49:16.108859 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 145/287] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:49:15 2022] DELETE /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:49:16.123683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:16.124418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:16.131609 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.132101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.132857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.133511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.150558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:16.158298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-29dcc899-3c45-4062-afae-de9abd5ec9ff tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1200 microversion: 2.1 time: 0.105937 Jun 07 04:49:16.159241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 143/288] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:16 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:16.292638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:16.301288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f72925db-d3a8-40b1-850a-b8becd2c6179 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1504 microversion: 2.1 time: 0.190309 Jun 07 04:49:16.302532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 146/289] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:16 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:16.342912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:16.343708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:16.350215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.350940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.351715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:16.352861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:16.486725 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:16.494750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7496e2fe-6ed5-41cd-897f-06be8bb8baea tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.155749 Jun 07 04:49:16.495321 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 144/290] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:16 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:17.175778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:17.176405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:17.182934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.183382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.184140 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.184582 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.248468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:17.256092 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-27fde038-f6a2-4a62-801b-0ef943dc56f0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1200 microversion: 2.1 time: 0.084153 Jun 07 04:49:17.256658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 147/291] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:17 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:17.320091 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:17.321063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:17.328702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.329855 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.330895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.331430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.491203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:17.500027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f95ed03e-c3ea-48e1-bd47-fb8de2363e88 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1504 microversion: 2.1 time: 0.184658 Jun 07 04:49:17.501072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 145/292] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:17 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:17.512537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:17.513183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:17.520239 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.520664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.521516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:17.521917 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:17.668916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:17.691446 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4ae5601f-2051-451a-a5b0-c0cea72cafba tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.182805 Jun 07 04:49:17.693102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 148/293] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:17 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:18.273406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:18.274089 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:18.280169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.280620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.281398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.281827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.344505 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:18.352401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bd9247e0-7085-472e-b327-153ec1a7e55d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1200 microversion: 2.1 time: 0.082344 Jun 07 04:49:18.353415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 146/294] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:18 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:18.517432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:18.518032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:18.524501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.524938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.525699 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.526127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.655180 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:18.662803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9309f379-8a1f-4ddb-828c-4109c2755924 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1504 microversion: 2.1 time: 0.149175 Jun 07 04:49:18.663370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 149/295] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:18 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:18.709955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:18.710657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:18.719564 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.720096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.721771 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:18.722773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:18.957774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:18.970445 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-01b02235-0e9b-4e6b-8deb-da7d27b5bb94 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.264548 Jun 07 04:49:18.972245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 147/296] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:18 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:19.370574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:19.371095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:19.391371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:19.391843 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:19.392723 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:19.394503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:19.461823 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:19.469150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-61c98e77-17fb-44b9-9d4b-a500efbdaa6a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1210 microversion: 2.1 time: 0.104109 Jun 07 04:49:19.469750 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 150/297] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:19 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:19.694220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:19.697060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:19.703432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:19.703884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:19.705351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:19.705792 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:19.901850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:19.911726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-38ff3faf-e874-4b61-ac93-84af5f60d236 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1504 microversion: 2.1 time: 0.220841 Jun 07 04:49:19.912316 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 148/298] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:19 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:19.989717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:19.990536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:20.006525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.007033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:20.008007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.008633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:20.385169 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:20.393442 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-07c2a70e-cb75-48f7-abb1-aecd5f259f68 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.407800 Jun 07 04:49:20.394006 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 151/299] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:19 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:20.486688 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:20.487312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:20.500270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.500270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:20.501181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.501661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:20.710412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:20.719848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:20.733354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-303bd669-34b8-44c7-af34-4d6b22651cc0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1278 microversion: 2.1 time: 0.250144 Jun 07 04:49:20.735905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 149/300] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:20 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:20.932438 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:20.934033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:20.943924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.944668 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:20.946508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:20.947285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.092411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:21.104710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a670024d-2e07-45b4-a4b5-ea30a7a02cde tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1504 microversion: 2.1 time: 0.177845 Jun 07 04:49:21.113816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 152/301] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:20 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:21.411379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:21.412008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:21.421446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:21.422212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.423215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:21.423915 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.600636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:21.612111 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-67999762-997a-4955-b58c-0d0ea8e9a1e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.205205 Jun 07 04:49:21.612874 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 150/302] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:21 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:21.618153 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-b11e0b07-c985-4db5-aadc-e6b915e7848d req-b23869a2-5816-4f8c-a0aa-a7a3d0647e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43beb8a-ec24-46e9-b287-9aa8ffb08563", "name": "network-vif-deleted", "tag": "74048895-16de-4ebe-a0b5-5666faa9d16e"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:21.627935 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:21.640290 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-b11e0b07-c985-4db5-aadc-e6b915e7848d req-b23869a2-5816-4f8c-a0aa-a7a3d0647e6b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:21.641851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-b11e0b07-c985-4db5-aadc-e6b915e7848d req-b23869a2-5816-4f8c-a0aa-a7a3d0647e6b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.663703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-b11e0b07-c985-4db5-aadc-e6b915e7848d req-b23869a2-5816-4f8c-a0aa-a7a3d0647e6b service nova] Creating event network-vif-deleted:74048895-16de-4ebe-a0b5-5666faa9d16e for instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 on hv-cinder-83699 Jun 07 04:49:21.671026 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-b11e0b07-c985-4db5-aadc-e6b915e7848d req-b23869a2-5816-4f8c-a0aa-a7a3d0647e6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059353 Jun 07 04:49:21.672012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 153/303] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:49:21.753189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:21.754153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:21.761835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:21.762282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.763062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:21.763660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:21.955669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:21.964843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cb305eb4-b7ae-4dd5-b7ce-c6f7a0860036 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.215825 Jun 07 04:49:21.965726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 151/304] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:21 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:22.120603 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=8 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:22.126202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:22.126978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.135117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.135571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.136338 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.136809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.171036 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.171499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.171932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lazy-loading 'fault' on Instance uuid f43beb8a-ec24-46e9-b287-9aa8ffb08563 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:49:22.217741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e752d2f1f3244349ba9366acfab8e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733fa1d115c146b2b465a3da17ad3897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:22.225529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8b915603-ca3b-487d-942f-b82108238847 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 200 len: 1304 microversion: 2.1 time: 0.107748 Jun 07 04:49:22.226340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 154/305] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:22 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:22.630836 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:22.631467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.639401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.640047 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.640838 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.641397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.781524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:22.788896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9cb8deda-6d0d-49f9-a3cf-7910085281b1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1500 microversion: 2.1 time: 0.161879 Jun 07 04:49:22.789833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 152/306] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:22 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:22.805936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d649ae8-2e06-4009-9c07-2d20f8c00c0b"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:22.807031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.813706 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.814224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.815080 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.815575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.839905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] HTTP exception thrown: Cannot 'attach_volume' instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 while it is in vm_state rescued Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Request method failure captured: Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/os-volume_attachments HTTP/1.1 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 74 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthP1FPaEHk91cJ2SUPblGX7KIGhRI_8lpmS3ko3Mc7WmBvxeLXifeexXDE0NiX0s8JDSk3OfJrDfSMYrvoRFSKnEOTWuabvQ6nocThcJOrqUI5WcjF3VwY1RkISj4SCdvOvB4mXSfQ2-FaZUo0QxUu0gA5S-FDjY4qoPyzVkywdeVc Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:49:22.841742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}] Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f4b50b2d16134e02b13989bc2579a337 Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {"volumeAttachment": {"volumeId": "3d649ae8-2e06-4009-9c07-2d20f8c00c0b"}} Jun 07 04:49:22.843457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Cannot 'attach_volume' instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 while it is in vm_state rescued Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'server_id': '16ac6b6c-d38b-4b7d-9200-833ed36cc465', 'body': {'volumeAttachment': {'volumeId': '3d649ae8-2e06-4009-9c07-2d20f8c00c0b'}}} Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:49:22.844352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 while it is in vm_state rescued Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:49:22.845696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 while it is in vm_state rescued Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Returning 409 to user: Cannot 'attach_volume' instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 while it is in vm_state rescued {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b93fe1b7-103a-42bf-a9cf-2dcfaef85342 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041471 Jun 07 04:49:22.846812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 155/307] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:49:22 2022] POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 04:49:22.853067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:22.853657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.860139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.860591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.861408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.861889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.930850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ac74d49c-834d-4944-94cf-7cdf76fc3d6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/action" status: 202 len: 0 microversion: 2.1 time: 0.081092 Jun 07 04:49:22.931498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 153/308] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:49:22 2022] POST /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:49:22.939447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:22.940054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.956133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.956599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.957411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.957850 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.982272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:22.982972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:22.989594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.990051 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:22.991002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:22.991449 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:23.206270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:23.214224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-29bf468b-3775-43f2-bf69-15ba9f888f57 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.278538 Jun 07 04:49:23.214990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 156/309] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:22 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:23.227052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:23.235000 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-929b9936-39b4-4231-be74-cffc04b2b814 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.256572 Jun 07 04:49:23.235963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 154/310] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:22 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:23.244937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:23.245580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] [instance: f43beb8a-ec24-46e9-b287-9aa8ffb08563] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:23.252045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:23.252495 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:23.253277 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:23.253710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:23.268436 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] HTTP exception thrown: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Request method failure captured: Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 HTTP/1.1 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintiRQfzPfVJuaISQx_XRDd8-uyvI6Cyo9eh7jNDIXM2z8GCItqV7N5UBBrQthf9R0mDClkL5rbnJ7TapbhSMUirfBl57WuAR99wmljlZsAFsGdDFIQTxCnan05iya5LUI6Z-_LP_GbkrwNO_nGHKyCYa2UvQpvcxitVUAA_os985Ogk Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 733fa1d115c146b2b465a3da17ad3897 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesActionsTest-363334125 Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:49:23.270181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_733fa1d115c146b2b465a3da17ad3897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/733fa1d115c146b2b465a3da17ad3897"}]}] Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesActionsTest-363334125 Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 733fa1d115c146b2b465a3da17ad3897 Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesActionsTest-363334125 Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesActionsTest-363334125-project Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 4e752d2f1f3244349ba9366acfab8e41 Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesActionsTest-363334125-project Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. Jun 07 04:49:23.271472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'f43beb8a-ec24-46e9-b287-9aa8ffb08563'} Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:49:23.272547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. Jun 07 04:49:23.277116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:49:23.278494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] Returning 404 to user: Instance f43beb8a-ec24-46e9-b287-9aa8ffb08563 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:49:23.278494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dff3ffbf-0a15-4711-8c96-2f100e140220 tempest-VolumesActionsTest-363334125 tempest-VolumesActionsTest-363334125-project] 10.222.0.40 "GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563" status: 404 len: 111 microversion: 2.1 time: 0.032468 Jun 07 04:49:23.278494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 157/311] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:23 2022] GET /compute/v2.1/servers/f43beb8a-ec24-46e9-b287-9aa8ffb08563 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 04:49:23.694633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-843cfa41-3cc5-4e9b-b35b-261563cd4fec req-4e8c8a4c-36dd-42d0-8033-66aab1343d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3413578b-b03f-4a2b-b8a8-4f8515da19e2", "tag": "483abe59-eaa4-4119-a55c-abfa1e9a4fd8"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:23.704645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-843cfa41-3cc5-4e9b-b35b-261563cd4fec req-4e8c8a4c-36dd-42d0-8033-66aab1343d9a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:23.705252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-843cfa41-3cc5-4e9b-b35b-261563cd4fec req-4e8c8a4c-36dd-42d0-8033-66aab1343d9a service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:23.730283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-843cfa41-3cc5-4e9b-b35b-261563cd4fec req-4e8c8a4c-36dd-42d0-8033-66aab1343d9a service nova] Creating event network-changed:483abe59-eaa4-4119-a55c-abfa1e9a4fd8 for instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 on hv-cinder-83699 Jun 07 04:49:23.735014 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-843cfa41-3cc5-4e9b-b35b-261563cd4fec req-4e8c8a4c-36dd-42d0-8033-66aab1343d9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Jun 07 04:49:23.735597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 155/312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:24.231553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:24.232075 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:24.238106 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:24.238556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:24.239479 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:24.239920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:24.255328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:24.256544 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:24.265416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:24.265867 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:24.266634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:24.267066 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:24.424877 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:24.433483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-56088332-b305-4e6d-8b11-60cf48d8abbc tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.205960 Jun 07 04:49:24.434413 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 158/313] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:24 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:24.457033 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:24.465138 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-88532ca1-2e65-4380-b568-a36da6e3b9cc tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.216045 Jun 07 04:49:24.465744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 156/314] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:24 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:25.450401 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:25.451070 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:25.458090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:25.458535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:25.459296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:25.459727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:25.483386 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:25.484255 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:25.490660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:25.491124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:25.491878 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:25.492482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:25.660657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:25.669953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-18fdae05-de9f-444f-b171-0d95ecd29719 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.223292 Jun 07 04:49:25.670799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 159/315] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:25 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:25.683606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:25.691505 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-beea9bfd-c79d-4a93-a721-968563887302 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.212064 Jun 07 04:49:25.692524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 157/316] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:25 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:26.687940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:26.688459 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:26.694612 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:26.695091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:26.695858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:26.696945 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:26.708557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:26.709397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:26.718933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:26.719452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:26.720293 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:26.720792 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:26.905798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:26.910288 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:26.916257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c66aed16-28b3-4c66-a5b0-a4b8007b6ba2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.232033 Jun 07 04:49:26.918362 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 160/317] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:26 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:26.928566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b233d631-3d97-433c-83c8-e55e721b8f99 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.223809 Jun 07 04:49:26.929572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 158/318] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:26 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:27.935236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:27.935778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:27.941906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:27.942356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:27.943117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:27.943553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:27.947030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:27.947691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:27.954029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:27.954494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:27.955232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:27.955664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:28.144859 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:28.148769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:28.153392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-740dea7d-ba6d-4e75-baa4-537cd41dee73 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.222041 Jun 07 04:49:28.153976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 161/319] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:27 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:28.157446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e93a8836-3b12-4474-8ae9-f3ac95e2bc1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.214619 Jun 07 04:49:28.158008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 159/320] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:27 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:29.171107 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:29.171724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:29.174708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:29.175529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:29.177915 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:29.178373 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:29.179114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:29.179757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:29.182943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:29.183451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:29.184222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:29.184664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:29.198127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:29.382361 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:29.387873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:29.395342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d7ebd0c4-74d3-4495-b313-c9e400bcb880 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.228112 Jun 07 04:49:29.395951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 162/321] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:29 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:29.396533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-979b7383-5fbe-4efe-b9a9-2b64deb2d328 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.225830 Jun 07 04:49:29.397262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 160/322] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:29 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:30.208108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1762704049", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:30.255999 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] validate_networks() for None {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:49:30.413926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:30.414545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:30.421116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.421594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.422411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.422838 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.608301 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:49:30.608727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:49:30.609428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:49:30.609844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:49:30.610311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:49:30.613247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:30.623790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.624857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.625715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.626155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.631710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:30.641543 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ae19d31e-7a55-4914-94d6-2ce4db117752 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.231400 Jun 07 04:49:30.648436 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 161/323] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:30 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:30.648600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Getting quotas for project a0fe4ad19d6f41e1a74d8a870bc5b6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:49:30.649334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Getting quotas for user 52a3e5b6a96246338daf934a0c32e5f5 and project a0fe4ad19d6f41e1a74d8a870bc5b6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:49:30.653332 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:30.653940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:30.659944 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.660469 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.661150 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:30.661609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:30.670515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:49:30.672817 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:49:30.730252 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-edde1abf-84e1-4583-8f51-a97b82e3804d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525946 Jun 07 04:49:30.731613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 163/324] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:49:30.741485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-565279b2-3d35-4d88-a0d4-8ead32691efe tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:30.742652 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-565279b2-3d35-4d88-a0d4-8ead32691efe tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:30.840254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-565279b2-3d35-4d88-a0d4-8ead32691efe tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:30.855982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-565279b2-3d35-4d88-a0d4-8ead32691efe tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1215 microversion: 2.1 time: 0.118648 Jun 07 04:49:30.866392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 164/325] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:30 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:30.875745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:30.891075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-53093b42-b17c-41bc-9302-436e839b51b4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.247534 Jun 07 04:49:30.891990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 162/326] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:30 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:31.662840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:31.666061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:31.694184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.701754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:31.703911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.705686 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:31.872636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:31.873964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:31.885455 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:31.887356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=68 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:31.890004 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.891038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:31.892977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.893730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:31.895682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-87ced835-230b-4307-a374-1be5db8e8008 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1508 microversion: 2.1 time: 0.240727 Jun 07 04:49:31.896225 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 165/327] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:31 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:31.916466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:31.917633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:31.927702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.928451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:31.929461 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:31.930081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:32.012255 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:32.026717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9007c5cf-626f-4cf5-b6f1-67b2f82f7aba tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1219 microversion: 2.1 time: 0.158426 Jun 07 04:49:32.028236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 163/328] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:31 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:32.120116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:32.132485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-70002cc3-855c-4c16-91e1-497edb3cae95 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.225333 Jun 07 04:49:32.133208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 166/329] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:31 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:32.915845 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:32.917340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:32.932581 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:32.933939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:32.935265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:32.936103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:33.047630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:33.048550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:33.066590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:33.067926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:33.069355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:33.070147 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:33.190208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:33.208723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4cde03bf-61cd-41bc-89e8-0dad6ab6c5dd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1514 microversion: 2.1 time: 0.296789 Jun 07 04:49:33.221381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:32 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1514 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:33.232154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:33.233934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:33.264934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:33.265990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:33.270633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:33.271876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:33.355423 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:33.364951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-37462b36-7a09-4b3c-8ea7-752a40832f65 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1219 microversion: 2.1 time: 0.323258 Jun 07 04:49:33.366801 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 167/331] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:33 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1219 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:33.556824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:33.567473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cce6a9c0-b771-4e08-ba70-77948ffeaef7 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.344622 Jun 07 04:49:33.568010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 165/332] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:33 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:34.382417 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:34.385687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:34.393354 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:34.394670 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:34.395762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:34.396737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:34.506870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:34.517008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7b4485df-fa21-4ce5-8c0f-c8de1ca5698d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1273 microversion: 2.1 time: 0.138648 Jun 07 04:49:34.522057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 168/333] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:34 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:34.587847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:34.588511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:34.599090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:34.599875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:34.600893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:34.601562 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:34.607542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:34.773761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8267f514-6a14-4c30-8d18-c71281b71960 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: .version_select at 0x7f3d5de1ec10>, body: {"keypair": {"name": "tempest-keypair-537309053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGbj1BzMBQchL0DTe5NmPdk2bS3Ij4yPZoWsD0hHX/NZApFqOM+azCcLu9gMIz2Z77vargC/+RClPw+GU6HWWecodLU2JBZeysekzyxGx5zkFALhDZsa4fpnMLUOPkY6Q=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:34.803745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-8267f514-6a14-4c30-8d18-c71281b71960 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:49:34.808857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-8267f514-6a14-4c30-8d18-c71281b71960 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for user f4b50b2d16134e02b13989bc2579a337 and project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:49:34.863533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8267f514-6a14-4c30-8d18-c71281b71960 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095330 Jun 07 04:49:34.864505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 169/334] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:49:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:34.908601 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:34.918738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9e03d556-7713-4f89-99c5-eac38567d0fd tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.335158 Jun 07 04:49:34.922129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 166/335] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:34 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:35.538845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:35.540668 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:35.550381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:35.551683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:35.553691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:35.555736 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:35.652800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:35.705084 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-42b6ee60-cd86-442e-8255-230a1d97245f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1273 microversion: 2.1 time: 0.170324 Jun 07 04:49:35.705704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 170/336] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:35 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:35.938525 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:35.939212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:35.959186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:35.959952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:35.960752 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:35.961217 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:36.158998 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-653744548", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "networks": [{"uuid": "8b890ebf-e5fb-48ad-9e43-5b8796417f39"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:36.243117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] validate_networks() for [('8b890ebf-e5fb-48ad-9e43-5b8796417f39', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:49:36.324269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:36.337859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-98fa2dd3-200e-4731-9f07-1a44165c05ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.399076 Jun 07 04:49:36.339104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 167/337] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:35 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:36.530541 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-06c13376-cbeb-41b1-a1ae-364eb4bcbfba req-54364585-b59d-469b-ab8d-8fed7d50b186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3413578b-b03f-4a2b-b8a8-4f8515da19e2", "name": "network-vif-plugged", "status": "completed", "tag": "483abe59-eaa4-4119-a55c-abfa1e9a4fd8"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:36.543834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-06c13376-cbeb-41b1-a1ae-364eb4bcbfba req-54364585-b59d-469b-ab8d-8fed7d50b186 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:36.553253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-06c13376-cbeb-41b1-a1ae-364eb4bcbfba req-54364585-b59d-469b-ab8d-8fed7d50b186 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:36.576214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-06c13376-cbeb-41b1-a1ae-364eb4bcbfba req-54364585-b59d-469b-ab8d-8fed7d50b186 service nova] Creating event network-vif-plugged:483abe59-eaa4-4119-a55c-abfa1e9a4fd8 for instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 on hv-cinder-83699 Jun 07 04:49:36.587362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-06c13376-cbeb-41b1-a1ae-364eb4bcbfba req-54364585-b59d-469b-ab8d-8fed7d50b186 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061027 Jun 07 04:49:36.588284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 168/338] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:49:36.721798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:36.722459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:36.734863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:36.735583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:36.738127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:36.738754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.323273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:37.340440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b5a2f788-eba6-4399-83ce-21d8dfa03f49 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.622810 Jun 07 04:49:37.341035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 169/339] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:36 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:37.346429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-4b8278f5-c7dc-4875-88df-23dc6e751ca5 req-ad979c54-dbe7-4758-bbea-9221ee9717b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3392e8b0-1fd3-4e31-b7f0-c280fea07640", "tag": "229c1dfa-c4a4-47c9-8191-039bbead9a06"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:37.358871 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4b8278f5-c7dc-4875-88df-23dc6e751ca5 req-ad979c54-dbe7-4758-bbea-9221ee9717b7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:37.359595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4b8278f5-c7dc-4875-88df-23dc6e751ca5 req-ad979c54-dbe7-4758-bbea-9221ee9717b7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.378566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-4b8278f5-c7dc-4875-88df-23dc6e751ca5 req-ad979c54-dbe7-4758-bbea-9221ee9717b7 service nova] Creating event network-changed:229c1dfa-c4a4-47c9-8191-039bbead9a06 for instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 on hv-cinder-83699 Jun 07 04:49:37.386042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-4b8278f5-c7dc-4875-88df-23dc6e751ca5 req-ad979c54-dbe7-4758-bbea-9221ee9717b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041717 Jun 07 04:49:37.386986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 170/340] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:37.395290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:37.399280 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:37.406652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:37.407343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.408485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:37.409088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.530837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:49:37.531729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:49:37.532469 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:49:37.533144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:49:37.533822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:49:37.552498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:37.553370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.554763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:37.556162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:37.582307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Getting quotas for project 2633b0eac5074cf09342b51dbc2a45a0. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:49:37.588418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Getting quotas for user 73ee42dbb41a4b86b3e7a5855cd1b702 and project 2633b0eac5074cf09342b51dbc2a45a0. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:49:37.602980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:49:37.605775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:49:37.667497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ccd36656-9af8-4bbf-a34c-44f1ac8e8151 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512236 Jun 07 04:49:37.674979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 171/341] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:49:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:49:37.688018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-85d57ebb-b2c4-4c29-b6a2-bc953f316bd8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:37.688638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-85d57ebb-b2c4-4c29-b6a2-bc953f316bd8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:37.706205 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:37.730067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-68f4df4b-dada-4ce6-a9f6-ad0e59ec5653 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.341076 Jun 07 04:49:37.731818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 171/342] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:37 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:37.802632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-85d57ebb-b2c4-4c29-b6a2-bc953f316bd8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:37.819806 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-85d57ebb-b2c4-4c29-b6a2-bc953f316bd8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1218 microversion: 2.1 time: 0.143816 Jun 07 04:49:37.820405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 172/343] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:37 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:38.259809 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-663791772", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d86967f-e870-4525-94fe-c4c482d45be3"}], "security_groups": [{"name": "tempest-securitygroup--357372511"}], "key_name": "tempest-keypair-537309053", "user_data": "}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:38.357002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:38.357650 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:38.365414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:38.366117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:38.367050 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:38.368343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:38.390406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] validate_networks() for [('5d86967f-e870-4525-94fe-c4c482d45be3', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:49:38.781995 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:38.790669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5cdd54af-d037-45ee-99e1-ac22378414df tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.437389 Jun 07 04:49:38.791557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 173/344] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:38 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:38.796319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:38.796978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:38.803390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:38.803838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:38.804783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:38.805656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.062489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:39.070577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b02d95cd-10ce-4886-87f1-6a775c4b9fe4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1266 microversion: 2.1 time: 0.277793 Jun 07 04:49:39.071393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 174/345] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:38 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:39.076902 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:39.077753 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:39.087152 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.087884 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.088837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.089466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.109105 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:49:39.109710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:49:39.110190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:49:39.110588 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:49:39.111196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:49:39.122812 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.123536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.124739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.125373 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.142907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:49:39.149136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Getting quotas for user f4b50b2d16134e02b13989bc2579a337 and project 11bd1cc2e8e8455b8e6e656f76b603d8. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:49:39.161723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:49:39.165012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:49:39.174272 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:39.184623 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c0ee9b2b-99b3-412b-a35d-c259614b480c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1270 microversion: 2.1 time: 0.112047 Jun 07 04:49:39.186054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 175/346] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:39 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:39.219270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-35a543c2-a8fe-42bf-bc5d-3bca28335831 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.964972 Jun 07 04:49:39.224783 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 172/347] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:49:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:49:39.229888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dfadfad0-e0d8-4076-bed5-8b2c59419ef8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:39.230504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dfadfad0-e0d8-4076-bed5-8b2c59419ef8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:39.286152 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-dfadfad0-e0d8-4076-bed5-8b2c59419ef8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:39.294104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dfadfad0-e0d8-4076-bed5-8b2c59419ef8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1244 microversion: 2.1 time: 0.067962 Jun 07 04:49:39.303555 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 176/348] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:39 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1244 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:39.808580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:39.809986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:39.816921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.817396 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.818528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:39.819119 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:39.964318 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:39.973336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1774aa8b-b46c-4c81-b91a-dc21c1189e94 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.170343 Jun 07 04:49:39.983828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 173/349] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:39 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:40.088369 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:40.089849 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:40.096132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.096643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.097511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.098009 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.203362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:40.204349 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:40.211909 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.212848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.213858 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.214490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.245982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:40.254124 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f9b1edf6-a7a7-49aa-81cf-ba8d7c14133e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1453 microversion: 2.1 time: 0.170142 Jun 07 04:49:40.255115 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 177/350] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:40 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:40.273502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:40.275553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:40.283229 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.284127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.285212 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.285879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.293988 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:40.302147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5cc90fd6-fd45-4596-91e2-f1a4c2558253 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1270 microversion: 2.1 time: 0.102702 Jun 07 04:49:40.307382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 174/351] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:40 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:40.312810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:40.313658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:40.331432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.332301 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.333632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:40.334296 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:40.434680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:40.444059 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-90c93c12-00ca-4ea7-9c5f-a6e38ce4327d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1248 microversion: 2.1 time: 0.135215 Jun 07 04:49:40.444856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 175/352] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:40 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1248 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:40.499847 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:40.508755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-57c0c183-07ef-4a8f-b865-baf8d936a8d0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1453 microversion: 2.1 time: 0.238758 Jun 07 04:49:40.509533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 178/353] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:40 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:40.994191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:40.996391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:41.004357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.005094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.006282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.006934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.204169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:41.215285 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9e4638b7-2f1e-4609-8ed9-48080e60a0d6 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.227881 Jun 07 04:49:41.225541 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 176/354] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:40 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:41.329554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:41.331362 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:41.339628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.340532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.341617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.342241 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.435601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:41.443582 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8089166f-3426-46c7-b20f-72e645dd82a7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1270 microversion: 2.1 time: 0.120019 Jun 07 04:49:41.453267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 179/355] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:41 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:41.465597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:41.466666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:41.474549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.475393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.476405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:41.477131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:41.602637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:41.608929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a910945a-53d6-47dc-b70f-0373a29624a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1248 microversion: 2.1 time: 0.151328 Jun 07 04:49:41.609811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 177/356] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:41 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:42.234979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:42.236204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:42.247244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.247674 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.251868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.252327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.463026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:42.464849 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:42.483828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.484509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.485284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.486376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.765478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:42.771051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:42.779089 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0396dfbb-4301-4d30-83c6-e34b7dc59346 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1270 microversion: 2.1 time: 0.321323 Jun 07 04:49:42.783345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 178/357] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:42 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1270 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:42.792407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cf72b415-b916-45d1-a9b7-52c503198721 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.561413 Jun 07 04:49:42.795432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 180/358] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:42 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:42.807572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:42.808297 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:42.825776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.826231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.827037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:42.827482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:42.954030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:42.964756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5a8ec63b-17ba-4eae-8a02-a4bebe3374c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1296 microversion: 2.1 time: 0.180233 Jun 07 04:49:42.978876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 179/359] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:42 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1296 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:43.192016 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-186a0929-8b4d-474d-ba4c-e58d207a34f8 req-7e59151d-0806-4ec5-93da-214ee5335461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3413578b-b03f-4a2b-b8a8-4f8515da19e2", "tag": "483abe59-eaa4-4119-a55c-abfa1e9a4fd8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:43.204541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-186a0929-8b4d-474d-ba4c-e58d207a34f8 req-7e59151d-0806-4ec5-93da-214ee5335461 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:43.205344 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-186a0929-8b4d-474d-ba4c-e58d207a34f8 req-7e59151d-0806-4ec5-93da-214ee5335461 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:43.219128 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-186a0929-8b4d-474d-ba4c-e58d207a34f8 req-7e59151d-0806-4ec5-93da-214ee5335461 service nova] Creating event network-changed:483abe59-eaa4-4119-a55c-abfa1e9a4fd8 for instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 on hv-cinder-83699 Jun 07 04:49:43.224609 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-186a0929-8b4d-474d-ba4c-e58d207a34f8 req-7e59151d-0806-4ec5-93da-214ee5335461 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036330 Jun 07 04:49:43.226141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 181/360] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:43.800979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:43.802796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:43.811034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:43.811490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:43.812665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:43.813292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:43.814344 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:43.815189 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:43.827059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:43.827513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:43.828293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:43.828728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:43.950931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:43.972410 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1bc66d07-b933-4fd3-bff4-a35f41073fc8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1276 microversion: 2.1 time: 0.175463 Jun 07 04:49:43.973472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 180/361] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:43 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:43.988687 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:43.992375 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:44.001576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:44.002278 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:44.003220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:44.003816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:44.117958 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:44.130218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-93c02395-0ad3-4142-b147-d7c8340f25af tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1302 microversion: 2.1 time: 0.148642 Jun 07 04:49:44.131173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 181/362] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:43 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:44.295218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:44.305463 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-db6e2c6a-5da1-4500-a263-594a8b2ca228 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.495567 Jun 07 04:49:44.308521 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 182/363] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:43 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:44.992921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:44.993560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:45.011047 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.011717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.013842 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.014428 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.150579 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:45.152073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:45.161851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.162660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.164095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.164782 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.205198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:45.220172 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ce0da2fa-abb6-440e-b371-4e330fd26071 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.232065 Jun 07 04:49:45.221187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 182/364] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:44 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:45.277384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:45.286052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-462949d2-058e-4313-8f2d-f2192c5638ef tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1302 microversion: 2.1 time: 0.141365 Jun 07 04:49:45.296858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 183/365] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:45 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:45.325722 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:45.326407 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:45.339934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.340472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.341313 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:45.341796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:45.520486 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:45.529037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-76f785ad-d0e0-4b8e-90cf-621bfcbd4bd5 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.208855 Jun 07 04:49:45.529942 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 183/366] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:45 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:46.237305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:46.238833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:46.249297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.250628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.251665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.252319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.302915 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:46.304377 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:46.315139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.318896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.320042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.322743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.538010 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:46.546489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-38b08d29-626c-4ecf-8cde-b6762b406b2c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.313016 Jun 07 04:49:46.550049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 184/367] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:46 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:46.558522 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:46.560989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:46.582532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.583246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.584185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.584794 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.598721 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:46.686229 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:46.690186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:46.695731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5fe1cce7-8291-4dbd-9f69-9fb9476c0ebd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.396089 Jun 07 04:49:46.696322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 184/368] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:46 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:46.734083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-9e318a3d-4d29-4ca9-8552-ac98b20b690e req-37ea17ec-2dc4-4f83-9eff-08d2f95f62e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3392e8b0-1fd3-4e31-b7f0-c280fea07640", "name": "network-vif-plugged", "status": "completed", "tag": "229c1dfa-c4a4-47c9-8191-039bbead9a06"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:46.774209 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-9e318a3d-4d29-4ca9-8552-ac98b20b690e req-37ea17ec-2dc4-4f83-9eff-08d2f95f62e5 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.774856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-9e318a3d-4d29-4ca9-8552-ac98b20b690e req-37ea17ec-2dc4-4f83-9eff-08d2f95f62e5 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.810559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-9e318a3d-4d29-4ca9-8552-ac98b20b690e req-37ea17ec-2dc4-4f83-9eff-08d2f95f62e5 service nova] Creating event network-vif-plugged:229c1dfa-c4a4-47c9-8191-039bbead9a06 for instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 on hv-cinder-83699 Jun 07 04:49:46.822475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-9e318a3d-4d29-4ca9-8552-ac98b20b690e req-37ea17ec-2dc4-4f83-9eff-08d2f95f62e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098006 Jun 07 04:49:46.825417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 185/369] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:46.835853 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-2fe27ab2-acbd-42c4-97c8-d4dca4fcc2b7 req-0020aa76-f002-4e09-90bb-56b13b2cf4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5c23bc-1cd0-4668-8659-40bf7dd23439", "tag": "6d0a6069-a37b-48e6-88fc-ad44341869db"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:46.853755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-2fe27ab2-acbd-42c4-97c8-d4dca4fcc2b7 req-0020aa76-f002-4e09-90bb-56b13b2cf4d7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:46.854309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-2fe27ab2-acbd-42c4-97c8-d4dca4fcc2b7 req-0020aa76-f002-4e09-90bb-56b13b2cf4d7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:46.870782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-2fe27ab2-acbd-42c4-97c8-d4dca4fcc2b7 req-0020aa76-f002-4e09-90bb-56b13b2cf4d7 service nova] Creating event network-changed:6d0a6069-a37b-48e6-88fc-ad44341869db for instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 on hv-cinder-83699 Jun 07 04:49:46.871057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:46.876376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-2fe27ab2-acbd-42c4-97c8-d4dca4fcc2b7 req-0020aa76-f002-4e09-90bb-56b13b2cf4d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050475 Jun 07 04:49:46.877073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 186/370] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:46.884035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e17d7ace-f672-4032-845b-01c6c999fa82 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.331737 Jun 07 04:49:46.884811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 185/371] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:46 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:47.569709 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:47.572657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:47.582877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:47.583675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:47.586446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:47.587374 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:47.714927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:47.715555 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:47.721097 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:47.727481 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:47.732628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:47.734315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:47.734762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:47.904274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:47.931919 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b1c38ab2-64c5-40b5-8496-36f0cdf31009 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.368219 Jun 07 04:49:47.949362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 187/372] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:47 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:47.993761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:47.994379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:47.997006 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:48.010155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ad0a2816-8904-43ad-9544-e60de5773c9e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.301726 Jun 07 04:49:48.011099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 186/373] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:47 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:48.012551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:48.013022 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:48.014666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:48.015458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:48.210545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:48.221632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2d6a39b9-690d-447e-9f95-86fa8e8cb521 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.246100 Jun 07 04:49:48.232477 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 188/374] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:47 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:48.931417 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-fe1fabd4-0b3e-4472-a505-538e89289606 req-865712e4-137e-41a4-bb2a-efc9a12caecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:48.939645 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-fe1fabd4-0b3e-4472-a505-538e89289606 req-865712e4-137e-41a4-bb2a-efc9a12caecf service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:48.940318 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-fe1fabd4-0b3e-4472-a505-538e89289606 req-865712e4-137e-41a4-bb2a-efc9a12caecf service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:48.954492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-fe1fabd4-0b3e-4472-a505-538e89289606 req-865712e4-137e-41a4-bb2a-efc9a12caecf service nova] Creating event network-changed:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:49:48.956693 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:48.957584 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:48.959568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-fe1fabd4-0b3e-4472-a505-538e89289606 req-865712e4-137e-41a4-bb2a-efc9a12caecf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Jun 07 04:49:48.960412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 187/375] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:49:48.966358 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:48.966865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:48.967937 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:48.968428 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:49.031869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:49.033580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:49.045495 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:49.046428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:49.047408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:49.048032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:49.133694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:49.159324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:49.161592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:49.172906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0335fb24-0086-463f-9b82-a871c6a742a6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.219344 Jun 07 04:49:49.188857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 189/376] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:48 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:49.229746 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:49.238375 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-41580e5a-34a8-44fe-909e-5738f1c0d160 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.212337 Jun 07 04:49:49.239974 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:49.240698 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:49.248094 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 188/377] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:49 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:49.248615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:49.249070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:49.250309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:49.250746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:49.400758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:49.409073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f27d5c8-e9f6-4e5d-a668-5cce2af28b44 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.173282 Jun 07 04:49:49.418832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 190/378] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:49 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:50.194043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:50.194967 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:50.197118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=22 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:50.204028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.204028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.204028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.204028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.256046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:50.256677 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:50.264755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.265195 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.266268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.266707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.404250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:50.412054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d8715425-4cc3-4b16-b0de-5d459afb7d4f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.221920 Jun 07 04:49:50.412624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 189/379] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:50 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:50.425964 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:50.426572 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:50.432525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.435710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:50.437534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.438358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:50.438833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:50.443233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8a80988d-9384-4462-8fe1-2c9812f012b9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.191753 Jun 07 04:49:50.443806 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 191/380] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:50 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:50.570494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:50.577849 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f3edc306-c7f5-4b57-8a8f-6d363d4df023 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1315 microversion: 2.1 time: 0.155536 Jun 07 04:49:50.578338 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 190/381] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:50 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:51.427982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:51.428592 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:51.436092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.436600 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.437311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.437745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.460012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:51.461872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:51.468386 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.468857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.469825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.470259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.659325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:51.667723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2a49d29d-b838-4960-8bb4-a55e6b1f79e8 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.243545 Jun 07 04:49:51.668297 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 192/382] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:51 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:51.677261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:51.678819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:51.679613 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:51.683980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7a6192f0-b7c3-450f-8098-63288b669217 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.227629 Jun 07 04:49:51.684557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 191/383] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:51 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:51.685939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.686389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.687161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.687594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.824042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:51.831706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a2741a1b-1c1f-46af-89be-c39313be785d tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1465 microversion: 2.1 time: 0.162422 Jun 07 04:49:51.832276 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 193/384] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:51 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:51.874503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:51.875010 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:51.878007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:51.884926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.885418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.886201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:51.886634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:51.911584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:49:51.986648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-99856388-52a0-4d49-96cc-c5079757a775 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 204 len: 0 microversion: 2.1 time: 0.117845 Jun 07 04:49:51.987148 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 192/385] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:49:51 2022] DELETE /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:49:51.995622 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:51.996243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:52.003103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.003748 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.004529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.004963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.139251 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:52.147112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1844371a-0eee-490f-9ae3-a4f3e54265e7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1471 microversion: 2.1 time: 0.155536 Jun 07 04:49:52.147717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 194/386] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:51 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:52.686479 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:52.687864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:52.700151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:52.700697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:52.707517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.707974 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.708743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.709176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.710810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.711452 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.712224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:52.712759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:52.987169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:52.994948 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:52.995202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-189af1dc-7cca-4766-9666-9b4a0aa8577c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.299089 Jun 07 04:49:52.995788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 195/387] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:52 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:53.003218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1549f8e4-96d6-45d4-bb08-e3d669fca462 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.322272 Jun 07 04:49:53.005264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 193/388] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:52 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:53.165810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:53.166435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:53.178016 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:53.178502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:53.179312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:53.179890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:53.319026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:53.326918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6c62ed64-b37a-45dd-8867-bfa954f6ce21 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1471 microversion: 2.1 time: 0.165500 Jun 07 04:49:53.327435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 196/389] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:53 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:54.013198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:54.013828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:54.020550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.021197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.022083 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.022583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.023123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:54.024755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:54.033400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.034149 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.036904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.037552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.258254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:54.261062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:54.268914 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2a961b13-e28b-4511-871c-d04c01186c2f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.259922 Jun 07 04:49:54.269071 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e0c33344-5e21-4989-be9a-b21a542534cf tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.252354 Jun 07 04:49:54.273271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 197/390] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:54 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:54.273414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 194/391] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:54 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:54.343943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:54.344656 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:54.350914 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.351860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.352658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.353091 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.484665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:54.493715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4323fc51-756f-4bac-8b67-98d4aa894dc7 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1471 microversion: 2.1 time: 0.153578 Jun 07 04:49:54.494390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 198/392] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:54 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:54.699694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-e2a55c9f-9917-490c-9f42-8a5bdd57547d req-9fb1392c-ca69-4b38-9641-a3835c7f76c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5c23bc-1cd0-4668-8659-40bf7dd23439", "name": "network-vif-plugged", "status": "completed", "tag": "6d0a6069-a37b-48e6-88fc-ad44341869db"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:54.708424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e2a55c9f-9917-490c-9f42-8a5bdd57547d req-9fb1392c-ca69-4b38-9641-a3835c7f76c5 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:54.708932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e2a55c9f-9917-490c-9f42-8a5bdd57547d req-9fb1392c-ca69-4b38-9641-a3835c7f76c5 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:54.723113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-e2a55c9f-9917-490c-9f42-8a5bdd57547d req-9fb1392c-ca69-4b38-9641-a3835c7f76c5 service nova] Creating event network-vif-plugged:6d0a6069-a37b-48e6-88fc-ad44341869db for instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 on hv-cinder-83699 Jun 07 04:49:54.729043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-e2a55c9f-9917-490c-9f42-8a5bdd57547d req-9fb1392c-ca69-4b38-9641-a3835c7f76c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Jun 07 04:49:54.729657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 195/393] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:55.285818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:55.286514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:55.286722 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:55.287412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:55.293635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.294095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.294420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.295044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.295478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.295932 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.296103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.296374 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.506231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:55.512319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:55.514232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3b4b784a-cd21-42f9-be2f-13fb7e00eb8d tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.232256 Jun 07 04:49:55.514820 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 199/394] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:55 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:55.519908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5407cc28-dbc2-47c5-8258-41bc55e7279e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.237425 Jun 07 04:49:55.520357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:55.521271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 196/395] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:55 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:55.521399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:55.527498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.527964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.528778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:55.529264 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:55.659495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:55.667887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-171e30c8-13a1-4780-8d1f-17febb5b090f tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1471 microversion: 2.1 time: 0.152055 Jun 07 04:49:55.668512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 200/396] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:55 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:56.530829 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:56.531462 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:56.537187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:56.537654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.537828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:56.537959 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.538654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.539083 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.544893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.545385 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.546148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.546586 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.756706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:56.759307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:56.767414 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a1e36300-b281-4daf-9d51-3731d82ff31b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.233629 Jun 07 04:49:56.768186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 201/397] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:56 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:56.770328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1a620146-a47d-4bf6-b3b7-2c3f0ab4d3ad tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.243237 Jun 07 04:49:56.771408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 197/398] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:56 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:56.776582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:56.777591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:56.783879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.784262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.785963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:56.786858 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:56.928633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:56.932174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:56.938022 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-94a48f4a-105d-44fa-b5ab-7bada5ab01c1 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1471 microversion: 2.1 time: 0.165793 Jun 07 04:49:56.938591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 202/399] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:56 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:57.344714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-032db10d-4767-4416-8d33-a9894cf45230 req-ee8618ad-34f8-43a8-bbd2-3410bce7ce52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3392e8b0-1fd3-4e31-b7f0-c280fea07640", "name": "network-vif-deleted", "tag": "229c1dfa-c4a4-47c9-8191-039bbead9a06"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:49:57.352736 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-032db10d-4767-4416-8d33-a9894cf45230 req-ee8618ad-34f8-43a8-bbd2-3410bce7ce52 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:57.353174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-032db10d-4767-4416-8d33-a9894cf45230 req-ee8618ad-34f8-43a8-bbd2-3410bce7ce52 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:57.364224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-032db10d-4767-4416-8d33-a9894cf45230 req-ee8618ad-34f8-43a8-bbd2-3410bce7ce52 service nova] Creating event network-vif-deleted:229c1dfa-c4a4-47c9-8191-039bbead9a06 for instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 on hv-cinder-83699 Jun 07 04:49:57.369708 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-032db10d-4767-4416-8d33-a9894cf45230 req-ee8618ad-34f8-43a8-bbd2-3410bce7ce52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028538 Jun 07 04:49:57.370462 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 198/400] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:49:57.787303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:57.788588 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:57.793315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:57.794127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:57.795982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:57.796442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:57.797249 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:57.797685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:57.801997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:57.802408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:57.803347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:57.803849 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:58.028668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:58.032731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:58.037263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-996f86f8-04b9-40b7-985b-791deaa24ced tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.255743 Jun 07 04:49:58.041867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-55b0f55a-c92b-4cfb-8e27-63661f500463 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1318 microversion: 2.1 time: 0.257328 Jun 07 04:49:58.051135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 203/401] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:57 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:58.051135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:58.051135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:58.051667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 199/402] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:57 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:58.056400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:58.056848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:58.057797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:58.058510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:58.127786 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:58.136214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c9eaa4e9-aba2-4899-a4de-5427ff764d46 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1300 microversion: 2.1 time: 0.091267 Jun 07 04:49:58.136783 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 204/403] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:58 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:59.054263 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:59.055041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:59.059635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:59.060669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:59.063323 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.063774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.064547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.064978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.066878 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:59.068731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.069182 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.070159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.070793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.492394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:59.496394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:59.501449 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5c894bd4-1436-426a-b8f3-83afe478d00a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.451435 Jun 07 04:49:59.502055 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 200/404] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:59 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:49:59.504323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9a46f642-27b3-4afc-9e98-99caf04a78e0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1507 microversion: 2.1 time: 0.449523 Jun 07 04:49:59.504987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 205/405] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:59 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:49:59.509913 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:49:59.510530 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:49:59.516550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.517008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.517803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.518206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.554938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:49:59.555398 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:49:59.555851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lazy-loading 'fault' on Instance uuid 3392e8b0-1fd3-4e31-b7f0-c280fea07640 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:49:59.605981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3e5b6a96246338daf934a0c32e5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe4ad19d6f41e1a74d8a870bc5b6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:49:59.609686 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:49:59.616019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-de120be5-b47d-40fb-a3ca-8b2c8305b5b4 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 200 len: 1305 microversion: 2.1 time: 0.109663 Jun 07 04:49:59.616607 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 201/406] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:49:59 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:50:00.517959 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:00.518577 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:00.525842 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:00.526329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:00.527110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:00.527605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:00.636031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:00.638512 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] [instance: 3392e8b0-1fd3-4e31-b7f0-c280fea07640] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:00.648712 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:00.649201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:00.650047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:00.651178 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:00.674677 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:50:00.683402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-24c5224c-f558-4fc0-b6b7-7e83250ca5f2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.169179 Jun 07 04:50:00.684958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] HTTP exception thrown: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Request method failure captured: Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 HTTP/1.1 Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintjWBKNFv0uaqi97jEFXDkDdDVzUH8ROwDq4XHFL40TCvLlaNQobI-m-0HAMcWCNeWmTl7PluYCtoiy64cqOamjCwTZWkClQZ0Y0Rh5NRN9bqDPjmLkgWk6yx0vpNoPHmWCA7yx94vbhKY7tK3W-Ly8YF0KR4nGFbJuVpOn7Q6DNpDU Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: a0fe4ad19d6f41e1a74d8a870bc5b6dd Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesNegativeTest-352348003 Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:50:00.686729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0fe4ad19d6f41e1a74d8a870bc5b6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0fe4ad19d6f41e1a74d8a870bc5b6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0fe4ad19d6f41e1a74d8a870bc5b6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0fe4ad19d6f41e1a74d8a870bc5b6dd"}]}] Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesNegativeTest-352348003 Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: a0fe4ad19d6f41e1a74d8a870bc5b6dd Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesNegativeTest-352348003 Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesNegativeTest-352348003-project Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 52a3e5b6a96246338daf934a0c32e5f5 Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesNegativeTest-352348003-project Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. Jun 07 04:50:00.688114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '3392e8b0-1fd3-4e31-b7f0-c280fea07640'} Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:50:00.688878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. Jun 07 04:50:00.690130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:50:00.691228 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] Returning 404 to user: Instance 3392e8b0-1fd3-4e31-b7f0-c280fea07640 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:50:00.691228 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c7ea9ae5-abe0-4170-88bd-c287f0977d33 tempest-VolumesNegativeTest-352348003 tempest-VolumesNegativeTest-352348003-project] 10.222.0.40 "GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640" status: 404 len: 111 microversion: 2.1 time: 0.057812 Jun 07 04:50:00.691228 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 202/407] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:50:00 2022] GET /compute/v2.1/servers/3392e8b0-1fd3-4e31-b7f0-c280fea07640 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:50:00.698705 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 206/408] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:50:00 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:50:00.789404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-151a6d18-7c51-4688-a42c-963be0a0b6c5 req-60db80b0-890c-4b20-80e8-0c3aa89342c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "name": "network-vif-plugged", "status": "completed", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:50:00.798886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-151a6d18-7c51-4688-a42c-963be0a0b6c5 req-60db80b0-890c-4b20-80e8-0c3aa89342c9 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:00.799337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-151a6d18-7c51-4688-a42c-963be0a0b6c5 req-60db80b0-890c-4b20-80e8-0c3aa89342c9 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:00.810786 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-151a6d18-7c51-4688-a42c-963be0a0b6c5 req-60db80b0-890c-4b20-80e8-0c3aa89342c9 service nova] Creating event network-vif-plugged:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:50:00.818347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-151a6d18-7c51-4688-a42c-963be0a0b6c5 req-60db80b0-890c-4b20-80e8-0c3aa89342c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Jun 07 04:50:00.819091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 203/409] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:50:01.705641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:01.706255 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:01.712703 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:01.713153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:01.713957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:01.714399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:01.847281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:50:01.855443 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ba59f05d-165e-4650-8815-d59305fc251e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.153606 Jun 07 04:50:01.858835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 207/410] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:50:01 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:50:02.873546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:02.874745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:02.880968 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:02.881543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:02.882380 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:02.882908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:03.027309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:50:03.034665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-78e75267-9265-49e3-a486-5160f57069ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1369 microversion: 2.1 time: 0.166232 Jun 07 04:50:03.035224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 204/411] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:50:02 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:50:04.051687 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:04.052351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:04.059309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:04.059758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:04.060530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:04.060971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:04.201069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:50:04.208545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fec8badc-359b-4d23-aeac-191ffc72a3e8 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1563 microversion: 2.1 time: 0.160729 Jun 07 04:50:04.209105 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 208/412] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:50:04 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:50:04.224557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:04.225047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:04.231180 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:04.231631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:04.232396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:04.232827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:04.311943 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2741868d-e4f2-4237-b1a1-6a7d21d48ecb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091094 Jun 07 04:50:04.312527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 205/413] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 04:50:04 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:50:05.278641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-60d8235c-414f-445d-ab81-095379089c4a req-3c256d5c-dbd8-4034-a9c6-4bc0c5263a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:50:05.287306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-60d8235c-414f-445d-ab81-095379089c4a req-3c256d5c-dbd8-4034-a9c6-4bc0c5263a0c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:05.287833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-60d8235c-414f-445d-ab81-095379089c4a req-3c256d5c-dbd8-4034-a9c6-4bc0c5263a0c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:05.298837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-60d8235c-414f-445d-ab81-095379089c4a req-3c256d5c-dbd8-4034-a9c6-4bc0c5263a0c service nova] Creating event network-changed:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:50:05.303963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-60d8235c-414f-445d-ab81-095379089c4a req-3c256d5c-dbd8-4034-a9c6-4bc0c5263a0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029700 Jun 07 04:50:05.304553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 209/414] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:50:30.065940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:30.067079 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=14 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:30.071619 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:50:30.072111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:30.080086 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:30.080657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:30.081460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:30.081896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:30.106007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2bbfd6a6-add5-4410-becb-645908ebd4ce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/ips" status: 200 len: 143 microversion: 2.1 time: 0.041178 Jun 07 04:50:30.106577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 206/415] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 04:50:30 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/ips => generated 143 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:50:33.174769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa339343-45e4-4a7d-909b-74b0314c58d1"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:50:33.175958 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:33.178206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=9 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:33.178859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=38 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:33.184847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:33.185322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:33.186086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:33.186521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:39.120761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-23f15a70-be7e-48b2-9b04-a9a94fee4b13 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.950426 Jun 07 04:50:39.122256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 210/416] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:50:33 2022] POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments => generated 194 bytes in 5952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:50:52.400898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "564ac925-7378-4b0b-87fb-ec896522f927", "device": "/dev/sdb"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:50:52.402491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:50:52.404431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:52.405068 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:50:52.411523 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:52.411971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:52.412735 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:50:52.413170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:50:52.688297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8aaf8527-3cc6-41df-a6c1-988553f30a22 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "POST /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290520 Jun 07 04:50:52.689603 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 207/417] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:50:52 2022] POST /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:51:04.542233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:04.543188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:04.547371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d0e66b61-59a3-414c-a10e-281a7693064a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:51:04.554641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d0e66b61-59a3-414c-a10e-281a7693064a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:04.555092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d0e66b61-59a3-414c-a10e-281a7693064a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:04.620148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d0e66b61-59a3-414c-a10e-281a7693064a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Going to try to stop instance {{(pid=124422) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 04:51:04.664542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d0e66b61-59a3-414c-a10e-281a7693064a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action" status: 202 len: 0 microversion: 2.1 time: 0.123605 Jun 07 04:51:04.665146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 211/418] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:51:04 2022] POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:51:04.675507 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:04.676355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:04.682247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:04.683371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:04.691477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:04.692000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:04.693054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:04.693660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:04.843404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:04.851318 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-66120992-4056-4f2f-a2f0-d081da558470 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.181848 Jun 07 04:51:04.851872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 208/419] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:04 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:05.869860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:05.870564 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:05.878095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:05.878555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:05.879319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:05.879757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:06.013136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:06.022397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-419415e3-df95-4450-a2e8-cdc9a0b6f6db tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.156779 Jun 07 04:51:06.022975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 212/420] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:05 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:07.039291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:07.039907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:07.046362 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:07.046810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:07.047593 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:07.048024 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:07.178831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:07.186731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ae0ba81e-16c8-4646-aa85-d04d585e5b64 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.151335 Jun 07 04:51:07.187287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 209/421] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:07 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:08.203475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:08.204083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:08.210718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:08.211169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:08.211929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:08.212369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:08.340781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:08.349197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f7d041d0-fa36-4356-908d-0ca1b1434366 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.149642 Jun 07 04:51:08.349804 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 213/422] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:08 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:09.366757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:09.367374 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:09.374128 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:09.374573 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:09.375364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:09.375801 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:09.511051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:09.519832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5d9aaa20-af19-464b-9b74-8065cf320db6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.156936 Jun 07 04:51:09.520395 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 210/423] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:09 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:10.536848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:10.537683 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:10.544108 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:10.544622 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:10.545473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:10.545971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:10.692642 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:10.701462 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b7d4029d-bd6a-4066-b3dd-0ee7ed88c5ab tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.168234 Jun 07 04:51:10.702080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 214/424] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:10 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:11.718695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:11.719311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:11.733826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:11.734326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:11.735027 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:11.735469 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:11.883057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:11.893388 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c313d1ed-f75a-41db-af44-be60f527da5b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.178371 Jun 07 04:51:11.894018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 211/425] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:11 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:12.911688 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:12.912292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:12.918721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:12.919163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:12.919913 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:12.920348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:13.052046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:13.060134 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8f9fc0b5-226b-423d-94c2-21f7c03bd6f8 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.153138 Jun 07 04:51:13.060704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 215/426] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:12 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:14.077712 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:14.078316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:14.084633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:14.085082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:14.086074 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:14.086287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:14.215933 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:14.225906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f67cc0d3-0bef-4b51-a063-962d195a91c1 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.151813 Jun 07 04:51:14.226527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 212/427] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:14 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:15.242907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:15.243512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:15.250326 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:15.250772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:15.252422 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:15.252889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:15.382258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:15.390141 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d1901883-217b-42d7-a5fc-06bd86339c76 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.151064 Jun 07 04:51:15.390706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 216/428] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:15 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:16.407040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:16.407662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:16.414368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:16.414797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:16.415546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:16.415978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:16.553802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:16.561768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-18af075c-c460-4997-9b93-eb7c94feaaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.158665 Jun 07 04:51:16.562333 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 213/429] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:16 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:17.580544 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:17.581158 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:17.587671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:17.588125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:17.588889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:17.589362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:17.719585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:17.728327 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7c755495-0047-4744-94ee-9e0d782a1312 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.151842 Jun 07 04:51:17.728896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 217/430] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:17 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:18.745834 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:18.746441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:18.754006 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:18.754453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:18.755210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:18.755637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:18.883138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:18.890977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c9b8b2d3-c9ca-44ce-a1e2-2ebcc883f5f0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.149009 Jun 07 04:51:18.891546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 214/431] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:18 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:19.908362 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:19.908906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:19.915392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:19.915841 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:19.916604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:19.917045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:20.046961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:20.055556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-89685746-fb00-4d2a-9a36-37c0a1526616 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.151358 Jun 07 04:51:20.056118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 218/432] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:19 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:21.071774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:21.072380 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:21.078766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:21.079844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:21.080600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:21.081033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:21.208909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:21.216738 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6c3ae04e-5245-4683-8e75-d37ab6ed313a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.148787 Jun 07 04:51:21.217325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 215/433] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:21 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:22.234440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:22.235490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:22.242647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:22.243093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:22.243930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:22.244368 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:22.375389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:22.383887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fccba1e4-7a03-4db9-b791-ee93fee78382 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1721 microversion: 2.1 time: 0.153708 Jun 07 04:51:22.384675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 219/434] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:22 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:23.401123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:23.401762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:23.407971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:23.408506 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:23.409353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:23.409793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:23.556167 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:23.565019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-eef2a95e-0c63-48f3-9c18-5057565db5d5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1698 microversion: 2.1 time: 0.167722 Jun 07 04:51:23.565718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 216/435] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:23 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:23.582541 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9598ad5-f89f-4b9b-865c-81a17b556f46 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:51:23.589058 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9598ad5-f89f-4b9b-865c-81a17b556f46 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:23.589543 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9598ad5-f89f-4b9b-865c-81a17b556f46 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:23.619455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e9598ad5-f89f-4b9b-865c-81a17b556f46 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Going to try to start instance {{(pid=124422) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 04:51:23.670295 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9598ad5-f89f-4b9b-865c-81a17b556f46 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action" status: 202 len: 0 microversion: 2.1 time: 0.092088 Jun 07 04:51:23.670852 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 220/436] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:51:23 2022] POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:51:23.679967 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:23.680580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:23.686780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:23.687224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:23.688111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:23.688553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:23.822425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:23.830708 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d259e687-a3ee-4351-a787-3654853c46e4 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.154617 Jun 07 04:51:23.831289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 217/437] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:23 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:24.849038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:24.849785 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:24.855961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:24.856408 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:24.857189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:24.857644 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:24.990772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:24.998927 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6f27fd45-fc8e-4ff2-ba9f-8db27cfb4c91 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.154882 Jun 07 04:51:24.999485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 221/438] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:24 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:26.016528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:26.017900 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:26.024454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:26.024898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:26.025712 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:26.026142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:26.155639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:26.163649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-891592e0-514a-4d23-a50d-eae82b697e99 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.150955 Jun 07 04:51:26.164214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 218/439] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:26 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:27.181314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:27.181920 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:27.188354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:27.188826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:27.189921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:27.190357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:27.317419 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:27.325383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-42be0c4c-e9da-46db-80bc-b134c48eb1d6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.147839 Jun 07 04:51:27.325936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 222/440] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:27 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:28.342503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:28.343139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:28.350136 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:28.350583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:28.351428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:28.351883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:28.488113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:28.496061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-523ba648-1d50-4d32-8150-55f92221ef19 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.157369 Jun 07 04:51:28.496629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 219/441] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:28 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:29.513213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:29.513850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:29.520314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:29.520769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:29.521563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:29.521996 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:29.655582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:29.664931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9af1575-1eda-4299-afb1-03ee408f08c5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1707 microversion: 2.1 time: 0.155537 Jun 07 04:51:29.665550 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 223/442] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:29 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:30.682908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:30.683544 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:30.692798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:30.693262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:30.694037 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:30.694533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:30.839530 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:30.848196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1880610f-f95b-44a0-a137-1ceb0baad21e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1711 microversion: 2.1 time: 0.169087 Jun 07 04:51:30.848761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 220/443] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:30 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:33.115204 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:33.115740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:33.122355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:33.122810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:33.123833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:33.124277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:33.250712 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lazy-loading 'services' on Instance uuid 5f5c23bc-1cd0-4668-8659-40bf7dd23439 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:51:33.352633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:33.365619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8a4a0af3-046d-4360-8328-bbb46e4a5144 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439/os-volume_attachments/564ac925-7378-4b0b-87fb-ec896522f927" status: 202 len: 0 microversion: 2.1 time: 0.254700 Jun 07 04:51:33.366224 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 224/444] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:51:33 2022] DELETE /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439/os-volume_attachments/564ac925-7378-4b0b-87fb-ec896522f927 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:51:34.479130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:34.479638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:34.486264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:34.486722 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:34.487493 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:34.487930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:34.515032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:51:34.600471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5f0309d5-da6a-4d2c-a655-5ca1f69473f1 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 204 len: 0 microversion: 2.1 time: 0.124748 Jun 07 04:51:34.601004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 221/445] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:51:34 2022] DELETE /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:51:34.612047 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:34.612743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:34.614648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=29 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:34.620994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:34.621473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:34.622245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:34.622681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:34.754744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:34.762242 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a1a511e8-4ca4-471b-b4ec-4a9ab6df550c tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1513 microversion: 2.1 time: 0.155903 Jun 07 04:51:34.762807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 225/446] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:34 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:35.779830 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:35.780579 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:35.782936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:35.788524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:35.788972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:35.789768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:35.790204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:35.793979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:35.928990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:35.936395 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a1f008a0-73d9-4cd8-aafc-8f6163c916e5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1513 microversion: 2.1 time: 0.160758 Jun 07 04:51:35.936957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 222/447] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:35 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:36.954363 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:36.955666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:36.962613 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:36.963175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:36.964218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:36.964758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:37.104043 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:37.112471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ea429d0f-89e9-445e-917c-20054ff07c92 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 200 len: 1513 microversion: 2.1 time: 0.162047 Jun 07 04:51:37.113057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 226/448] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:36 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:37.203631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-67cccfb1-2df1-4bb0-8bd3-9e5eb804c429 req-9c39f36d-29c1-4853-890f-199a465d9319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5c23bc-1cd0-4668-8659-40bf7dd23439", "name": "network-vif-deleted", "tag": "6d0a6069-a37b-48e6-88fc-ad44341869db"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:51:37.213135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-67cccfb1-2df1-4bb0-8bd3-9e5eb804c429 req-9c39f36d-29c1-4853-890f-199a465d9319 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:37.213626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-67cccfb1-2df1-4bb0-8bd3-9e5eb804c429 req-9c39f36d-29c1-4853-890f-199a465d9319 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:37.224542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-67cccfb1-2df1-4bb0-8bd3-9e5eb804c429 req-9c39f36d-29c1-4853-890f-199a465d9319 service nova] Creating event network-vif-deleted:6d0a6069-a37b-48e6-88fc-ad44341869db for instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 on hv-cinder-83699 Jun 07 04:51:37.229396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-67cccfb1-2df1-4bb0-8bd3-9e5eb804c429 req-9c39f36d-29c1-4853-890f-199a465d9319 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029302 Jun 07 04:51:37.230185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 223/449] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:51:37.568002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 04:51:37.568246 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 04:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 04:51:38.129569 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:38.130214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: 5f5c23bc-1cd0-4668-8659-40bf7dd23439] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:38.136871 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:38.137345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:38.138102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:38.138532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:38.152456 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] HTTP exception thrown: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Request method failure captured: Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 HTTP/1.1 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintjdNseVtxt808CS4Fu4zd7p14MmzzWPmNSzNhaxB1SQEasVAMzXBXcsEFBkt7d43cbcdb2fWmHURnyWs1H1-U0waOOQ-e7fK6rwNOCHv3-F0Ug0t7_l8a2hSQFctHwSiPCxgRHWON6QiiTgCY-Fcnn9Fo3FdgYKngZtFcSFs3FPjQM Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 2633b0eac5074cf09342b51dbc2a45a0 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:51:38.154102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2633b0eac5074cf09342b51dbc2a45a0"}]}] Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 2633b0eac5074cf09342b51dbc2a45a0 Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesSnapshotTestJSON-1441823741-project Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 73ee42dbb41a4b86b3e7a5855cd1b702 Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesSnapshotTestJSON-1441823741-project Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. Jun 07 04:51:38.155690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '5f5c23bc-1cd0-4668-8659-40bf7dd23439'} Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:51:38.156706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. Jun 07 04:51:38.159017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:51:38.160390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Returning 404 to user: Instance 5f5c23bc-1cd0-4668-8659-40bf7dd23439 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:51:38.160390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1fa457e1-acda-4057-ba58-f2e560cd31a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439" status: 404 len: 111 microversion: 2.1 time: 0.030640 Jun 07 04:51:38.160390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 227/450] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:38 2022] GET /compute/v2.1/servers/5f5c23bc-1cd0-4668-8659-40bf7dd23439 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:51:50.114876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:50.115716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=7 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:50.119774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1794012428", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "networks": [{"uuid": "8b890ebf-e5fb-48ad-9e43-5b8796417f39"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:51:50.172832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] validate_networks() for [('8b890ebf-e5fb-48ad-9e43-5b8796417f39', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:51:50.518142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:51:50.518553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:51:50.519023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:51:50.519428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:51:50.519835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:51:50.529874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:50.530692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:50.532044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:50.532564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:50.554614 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Getting quotas for project 2633b0eac5074cf09342b51dbc2a45a0. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:51:50.558535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Getting quotas for user 73ee42dbb41a4b86b3e7a5855cd1b702 and project 2633b0eac5074cf09342b51dbc2a45a0. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:51:50.570121 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:51:50.572454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:51:50.624345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3d042bdd-1df0-49de-9c6b-62c264fbdebd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510903 Jun 07 04:51:50.624992 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 224/451] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:51:50.635252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f14c1ed5-820c-4aba-8ed0-8d2b0ed3baf5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:50.635889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f14c1ed5-820c-4aba-8ed0-8d2b0ed3baf5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:50.638413 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=5 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:50.639064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=14 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:51:50.693035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f14c1ed5-820c-4aba-8ed0-8d2b0ed3baf5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:50.702021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f14c1ed5-820c-4aba-8ed0-8d2b0ed3baf5 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1219 microversion: 2.1 time: 0.070138 Jun 07 04:51:50.703088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 228/452] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:50 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:51.725027 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:51.725718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:51.732419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:51.732869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:51.733748 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:51.734189 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:51.805826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:51.813617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-db5e771d-8983-4833-8082-862ed5a6f90b tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1279 microversion: 2.1 time: 0.094093 Jun 07 04:51:51.815091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 225/453] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:51 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:52.833166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:52.833811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:52.840701 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:52.841242 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:52.842053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:52.842497 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:52.973314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:52.981771 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-799c6b55-334c-4772-a624-e4339d0a25c7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.153747 Jun 07 04:51:52.982353 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 229/454] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:52 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:53.068862 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-8d2047bb-8379-4d71-95de-94949ffe7fd5 req-fdbeff27-166a-4dab-91b4-7626eba4cdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf2269a6-84d5-4e78-a676-78b4318b60d4", "tag": "9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:51:53.078439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-8d2047bb-8379-4d71-95de-94949ffe7fd5 req-fdbeff27-166a-4dab-91b4-7626eba4cdca service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:53.078888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-8d2047bb-8379-4d71-95de-94949ffe7fd5 req-fdbeff27-166a-4dab-91b4-7626eba4cdca service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:53.090763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-8d2047bb-8379-4d71-95de-94949ffe7fd5 req-fdbeff27-166a-4dab-91b4-7626eba4cdca service nova] Creating event network-changed:9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c for instance bf2269a6-84d5-4e78-a676-78b4318b60d4 on hv-cinder-83699 Jun 07 04:51:53.095428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-8d2047bb-8379-4d71-95de-94949ffe7fd5 req-fdbeff27-166a-4dab-91b4-7626eba4cdca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031803 Jun 07 04:51:53.096400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 226/455] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:51:53.999317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:53.999926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:54.006355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:54.006797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:54.007547 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:54.007976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:54.141003 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:54.151093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3127e792-c150-4802-a922-e0876a94461e tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.155930 Jun 07 04:51:54.151734 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 230/456] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:53 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:55.170716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:55.171409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:55.177737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:55.178181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:55.178940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:55.179371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:55.506774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:55.514113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ff4ec7ab-3063-4eaf-af2b-533779511102 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.348176 Jun 07 04:51:55.514668 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 227/457] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:55 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:56.531563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:56.532196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:56.538770 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:56.539211 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:56.539969 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:56.540398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:56.669247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:56.679236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4efb1967-f511-48fd-8796-572873193373 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.151348 Jun 07 04:51:56.680049 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 231/458] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:56 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:57.695974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:57.696584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:57.702996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:57.703469 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:57.704867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:57.705324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:57.837591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:57.845068 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-61ed1f1e-14f8-4b3b-bfd8-d7e768a1db44 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.152797 Jun 07 04:51:57.845659 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 228/459] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:57 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:51:58.862343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:51:58.862963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:51:58.869458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:58.869912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:58.870678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:51:58.871118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:51:59.000360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:51:59.008361 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a903f640-6783-4556-9fe9-b1bcf422def6 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.149914 Jun 07 04:51:59.008921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 232/460] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:51:58 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:00.025567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:00.026200 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:00.033170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:00.033657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:00.034418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:00.034853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:00.167158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:00.174661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0e79f8a0-95d1-4508-bb16-69500ae46dfa tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.152854 Jun 07 04:52:00.175233 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 229/461] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:00 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:00.540394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-ca620bd2-28fb-45c1-b415-2c000ae96e25 req-3cc666a1-2bec-40a0-8782-b95c5309f93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2269a6-84d5-4e78-a676-78b4318b60d4", "name": "network-vif-plugged", "status": "completed", "tag": "9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:52:00.549719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-ca620bd2-28fb-45c1-b415-2c000ae96e25 req-3cc666a1-2bec-40a0-8782-b95c5309f93b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:00.550366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-ca620bd2-28fb-45c1-b415-2c000ae96e25 req-3cc666a1-2bec-40a0-8782-b95c5309f93b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:00.565248 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-ca620bd2-28fb-45c1-b415-2c000ae96e25 req-3cc666a1-2bec-40a0-8782-b95c5309f93b service nova] Creating event network-vif-plugged:9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c for instance bf2269a6-84d5-4e78-a676-78b4318b60d4 on hv-cinder-83699 Jun 07 04:52:00.570272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-ca620bd2-28fb-45c1-b415-2c000ae96e25 req-3cc666a1-2bec-40a0-8782-b95c5309f93b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Jun 07 04:52:00.571075 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 233/462] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:52:01.192372 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:01.192980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:01.194979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:01.195666 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:01.201674 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:01.202118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:01.202872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:01.203301 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:01.333799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:01.341214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-887a47d1-fbf5-476c-8c46-225ef4aeda89 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.153603 Jun 07 04:52:01.341840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 230/463] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:01 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:02.358431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:02.359156 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:02.361163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:02.367226 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:02.367678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:02.368448 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:02.368887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:02.688024 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:02.698618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-108e31cf-b8be-4cd0-99ef-8ebf06c50111 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1319 microversion: 2.1 time: 0.344298 Jun 07 04:52:02.707394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 234/464] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:02 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:03.715757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:03.716368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:03.722940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:03.723384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:03.724139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:03.724605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:03.902832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:03.910711 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d62ad8ee-beab-4cb8-9535-29c95a00a0a0 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1508 microversion: 2.1 time: 0.198766 Jun 07 04:52:03.911308 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 231/465] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:03 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:03.927389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2702103f-fbe1-41ef-ac8d-535d109dcaf0", "device": "/dev/sdb"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:52:03.929015 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:03.935455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:03.935898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:03.936648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:03.937080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:04.182507 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-715987c5-112d-46ea-8b1f-834ee95180e7 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "POST /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259291 Jun 07 04:52:04.183127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 235/466] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:52:03 2022] POST /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:52:11.127353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 04:52:11.128464 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 04:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 04:52:16.551918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 04:52:16.552492 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 04:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 04:52:26.539689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:26.540206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:26.542260 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:26.542927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=40 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:26.548999 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:26.549473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:26.550234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:26.550669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:26.672819 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lazy-loading 'services' on Instance uuid bf2269a6-84d5-4e78-a676-78b4318b60d4 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:52:26.785286 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f4f470fb-35ea-4368-b027-ce81982a79ef tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4/os-volume_attachments/2702103f-fbe1-41ef-ac8d-535d109dcaf0" status: 202 len: 0 microversion: 2.1 time: 0.249449 Jun 07 04:52:26.785869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 232/467] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:52:26 2022] DELETE /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4/os-volume_attachments/2702103f-fbe1-41ef-ac8d-535d109dcaf0 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:52:27.897152 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=18 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:27.898578 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:27.902632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:27.903225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:27.910435 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:27.910875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:27.911625 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:27.912055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:27.937803 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:52:28.012208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c8479c5a-2ef4-4e10-8058-1b08b05ea826 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 204 len: 0 microversion: 2.1 time: 0.116162 Jun 07 04:52:28.012897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 236/468] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:52:27 2022] DELETE /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:52:28.021903 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:28.022702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:28.029888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:28.030343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:28.031109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:28.031545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:28.162223 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:28.169754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4d33e338-11e9-45cb-bce5-91cd98a7e56f tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1514 microversion: 2.1 time: 0.152502 Jun 07 04:52:28.170305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 233/469] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:28 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:29.187814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:29.188535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:29.195549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:29.195992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:29.196745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:29.197175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:29.330012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:29.337468 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2b971ba4-dac3-4f96-bd30-8d5264d9e197 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1514 microversion: 2.1 time: 0.153815 Jun 07 04:52:29.338031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 237/470] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:29 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:30.355294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:30.355936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:30.362345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:30.362794 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:30.363558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:30.363995 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:30.496296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ee42dbb41a4b86b3e7a5855cd1b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2633b0eac5074cf09342b51dbc2a45a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:30.505190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-210476fd-2e92-499d-b1d5-444b31af69d3 tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 200 len: 1514 microversion: 2.1 time: 0.154525 Jun 07 04:52:30.505783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 234/471] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:30 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:30.753799 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-22ae2cc5-be77-4aae-b749-d1e528215831 req-e54a13b6-d610-4b8b-8885-2512f321bb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2269a6-84d5-4e78-a676-78b4318b60d4", "name": "network-vif-deleted", "tag": "9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:52:30.761908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-22ae2cc5-be77-4aae-b749-d1e528215831 req-e54a13b6-d610-4b8b-8885-2512f321bb53 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:30.762348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-22ae2cc5-be77-4aae-b749-d1e528215831 req-e54a13b6-d610-4b8b-8885-2512f321bb53 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:30.775417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-22ae2cc5-be77-4aae-b749-d1e528215831 req-e54a13b6-d610-4b8b-8885-2512f321bb53 service nova] Creating event network-vif-deleted:9b80faf9-4f81-4ff7-bd07-ae41e94b4a4c for instance bf2269a6-84d5-4e78-a676-78b4318b60d4 on hv-cinder-83699 Jun 07 04:52:30.780854 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-22ae2cc5-be77-4aae-b749-d1e528215831 req-e54a13b6-d610-4b8b-8885-2512f321bb53 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089865 Jun 07 04:52:30.781597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 238/472] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:52:31.522291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:31.523104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] [instance: bf2269a6-84d5-4e78-a676-78b4318b60d4] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:31.529587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:31.530036 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:31.530821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:31.531255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:31.544302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] HTTP exception thrown: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Request method failure captured: Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 HTTP/1.1 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintjdNseVtxt808CS4Fu4zd7p14MmzzWPmNSzNhaxB1SQEasVAMzXBXcsEFBkt7d43cbcdb2fWmHURnyWs1H1-U0waOOQ-e7fK6rwNOCHv3-F0Ug0t7_l8a2hSQFctHwSiPCxgRHWON6QiiTgCY-Fcnn9Fo3FdgYKngZtFcSFs3FPjQM Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 2633b0eac5074cf09342b51dbc2a45a0 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:52:31.545920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2633b0eac5074cf09342b51dbc2a45a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2633b0eac5074cf09342b51dbc2a45a0"}]}] Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 2633b0eac5074cf09342b51dbc2a45a0 Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1441823741 Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesSnapshotTestJSON-1441823741-project Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 73ee42dbb41a4b86b3e7a5855cd1b702 Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesSnapshotTestJSON-1441823741-project Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. Jun 07 04:52:31.547489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'bf2269a6-84d5-4e78-a676-78b4318b60d4'} Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:52:31.548312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. Jun 07 04:52:31.549813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:52:31.551137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] Returning 404 to user: Instance bf2269a6-84d5-4e78-a676-78b4318b60d4 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:52:31.551137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e8ff2409-8911-4e96-b035-c9c5bf7d88cd tempest-VolumesSnapshotTestJSON-1441823741 tempest-VolumesSnapshotTestJSON-1441823741-project] 10.222.0.40 "GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4" status: 404 len: 111 microversion: 2.1 time: 0.028846 Jun 07 04:52:31.551137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 235/473] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:31 2022] GET /compute/v2.1/servers/bf2269a6-84d5-4e78-a676-78b4318b60d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:52:41.193659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:41.194390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:41.293246 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8708bf5-6b56-4412-ae1e-bedea60d6606"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:52:41.294406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:41.300571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:41.301029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:41.301821 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:41.302258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:41.556221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1d0b7c48-f3fd-4003-a43f-06e203dc1668 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367301 Jun 07 04:52:41.556824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 239/474] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:52:41 2022] POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:52:49.041836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:52:49.042903 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:49.045456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=8 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:49.046175 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:52:49.052808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:49.053324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:49.054750 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:49.055471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:49.080215 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lazy-loading 'flavor' on Instance uuid 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:52:49.200355 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7759e36c-e7cc-4d93-82a2-82e6d1138829 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/action" status: 200 len: 32 microversion: 2.1 time: 0.163045 Jun 07 04:52:49.200863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 236/475] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:52:49 2022] POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:52:49.210954 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:49.211660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:49.218085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:49.218936 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:49.219344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:49.219713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:49.354978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:49.362929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7182d3c9-668b-40be-be5e-9d0eb52edd72 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.156626 Jun 07 04:52:49.363495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 240/476] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:49 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:50.381989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:50.382684 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:50.388929 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:50.389426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:50.390183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:50.390703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:50.519474 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:50.528200 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-776fd71a-8969-4305-bc7d-02257f568c45 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.150996 Jun 07 04:52:50.528753 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 237/477] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:50 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:51.545576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:51.546114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:51.552723 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:51.553175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:51.554634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:51.555071 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:51.683966 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:51.692046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c1774042-453d-45c9-a529-1605c9d31eb9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.150413 Jun 07 04:52:51.692614 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 241/478] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:51 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:52:52.709484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:52.710940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:52.717144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:52.717626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:52.718382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:52.718814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:52.856936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:52.864846 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-546e6dcb-a046-4316-96e3-9387a25addee tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.159600 Jun 07 04:52:52.865440 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 238/479] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:52 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:53.883189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:53.883733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:53.890086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:53.890532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:53.891279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:53.891714 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:54.030736 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:54.038862 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3de650fb-7932-4151-9e97-4558be0b85c4 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.160237 Jun 07 04:52:54.039421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 242/480] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:53 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:55.056244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:55.056874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:55.063666 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:55.064208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:55.065104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:55.065563 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:55.200342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:55.208302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6fe37274-98de-4503-be34-5bb2c127a19c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.156478 Jun 07 04:52:55.208863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 239/481] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:55 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:56.225086 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:56.225735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:56.232351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:56.232810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:56.233629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:56.234069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:56.361214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:56.369845 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-58361e2c-c86e-4238-b140-37b7ecad26b5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.148644 Jun 07 04:52:56.370411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 243/482] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:56 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:57.386836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:57.387457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:57.394091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:57.394542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:57.395323 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:57.395765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:57.534956 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:57.544168 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ebd93758-ce40-49a0-982b-d8f83e49f656 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.161455 Jun 07 04:52:57.544799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 240/483] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:57 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:58.561401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:58.562019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:58.569295 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:58.569751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:58.571119 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:58.571563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:58.788704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:52:58.798039 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ed65c311-6ecd-4216-ae21-0effd98700e3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.240391 Jun 07 04:52:58.798912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 244/484] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:58 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:52:59.816406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:52:59.817289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:52:59.825975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:59.826570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:52:59.827445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:52:59.827996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:00.108728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:00.119625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-714c37c0-03b7-4f19-b4cb-b010f25a9b11 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.307275 Jun 07 04:53:00.120137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 241/485] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:52:59 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:00.815995 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:00.816509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:00.823465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:00.823921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:00.824697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:00.825133 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:00.947179 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lazy-loading 'services' on Instance uuid 30fa9ff3-99a4-41d3-8492-a3a240d6d73e {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:53:01.046061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-210d2899-945e-429f-8a64-64afa25c24e6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments/aa339343-45e4-4a7d-909b-74b0314c58d1" status: 202 len: 0 microversion: 2.1 time: 0.447765 Jun 07 04:53:01.049659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 245/486] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:53:00 2022] DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments/aa339343-45e4-4a7d-909b-74b0314c58d1 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:53:01.135982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:01.137348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:01.144393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:01.145288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:01.147427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:01.147874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:01.381401 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:01.389942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9908ec3b-752f-44fa-b33e-efffb86f64ed tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.257929 Jun 07 04:53:01.390511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 242/487] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:01 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:02.412637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:02.413472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:02.427650 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:02.430324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:02.432760 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:02.433810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:02.698531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:02.707790 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fb32c06b-834f-494f-a9f5-8c37fc0f5c9c tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1734 microversion: 2.1 time: 0.303938 Jun 07 04:53:02.710336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 246/488] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:02 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:03.727032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:03.728063 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:03.747648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:03.748426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:03.749610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:03.750319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:03.921941 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:03.932091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-88cb2f3d-675c-4f50-b45b-36211c9a19a6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1714 microversion: 2.1 time: 0.209546 Jun 07 04:53:03.933900 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 243/489] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:03 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:04.058636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:04.059218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:04.072189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.074354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.075455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.076179 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.216766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f while it is in vm_state rescued Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Request method failure captured: Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments/a8708bf5-6b56-4412-ae1e-bedea60d6606 HTTP/1.1 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthP1FPaEHk91cJ2SUPblGX7KIGhRI_8lpmS3ko3Mc7WmBvxeLXifeexXDE0NiX0s8JDSk3OfJrDfSMYrvoRFSKnEOTWuabvQ6nocThcJOrqUI5WcjF3VwY1RkISj4SCdvOvB4mXSfQ2-FaZUo0QxUu0gA5S-FDjY4qoPyzVkywdeVc Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:53:04.219551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}] Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f4b50b2d16134e02b13989bc2579a337 Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:53:04.221186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Cannot 'detach_volume' instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f while it is in vm_state rescued Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'server_id': '7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f', 'id': 'a8708bf5-6b56-4412-ae1e-bedea60d6606'} Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:53:04.222064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f while it is in vm_state rescued Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f while it is in vm_state rescued Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:53:04.228286 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Returning 409 to user: Cannot 'detach_volume' instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f while it is in vm_state rescued {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:53:04.230137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fbb3c40c-f496-4b5b-ad26-9653493c37f6 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments/a8708bf5-6b56-4412-ae1e-bedea60d6606" status: 409 len: 152 microversion: 2.1 time: 0.169201 Jun 07 04:53:04.230137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 247/490] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:53:04 2022] DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments/a8708bf5-6b56-4412-ae1e-bedea60d6606 => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 04:53:04.239144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:04.239867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:04.275316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.283744 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.286163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.289627 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.371899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-28e22cc1-9f72-49e2-9543-2bbaaa8d317c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:04.378904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-28e22cc1-9f72-49e2-9543-2bbaaa8d317c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.379938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-28e22cc1-9f72-49e2-9543-2bbaaa8d317c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.386132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cabb5fbe-b9f6-4544-a6d9-0b5e27eddc38 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/action" status: 202 len: 0 microversion: 2.1 time: 0.155504 Jun 07 04:53:04.389920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 244/491] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:53:04 2022] POST /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:53:04.395381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:04.396138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:04.403283 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.404294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.405337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.405940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.419253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-28e22cc1-9f72-49e2-9543-2bbaaa8d317c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Going to try to stop instance {{(pid=124422) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 04:53:04.473065 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-28e22cc1-9f72-49e2-9543-2bbaaa8d317c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action" status: 202 len: 0 microversion: 2.1 time: 0.104685 Jun 07 04:53:04.473628 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 248/492] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:53:04 2022] POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:53:04.483099 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:04.483801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:04.490211 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.490781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.491439 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:04.493591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:04.806241 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:04.814716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:04.822988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4ce13bff-96d9-4e37-8ea9-24ea658cb083 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1722 microversion: 2.1 time: 0.431755 Jun 07 04:53:04.832757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e2aaf8e7-a461-454a-8438-47666717d918 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.345277 Jun 07 04:53:04.832757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 249/493] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:04 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:04.834116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 245/494] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:04 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:05.842539 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:05.843179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:05.845510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:05.847258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:05.852661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:05.853113 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:05.858039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:05.858189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:05.858651 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:05.858984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:05.859607 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:05.860137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:06.219648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:06.232282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d2d70e96-a93f-4ffd-b596-9baffd841ca1 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1722 microversion: 2.1 time: 0.394229 Jun 07 04:53:06.237122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 250/495] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:05 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:06.249837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:06.258243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5f50766e-9a38-41ee-9dbd-2c187b4c4e7c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.419651 Jun 07 04:53:06.259146 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 246/496] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:05 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:07.255203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:07.256396 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:07.278558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:07.279744 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:07.291965 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:07.292977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:07.293982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:07.294589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:07.302316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:07.302777 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:07.303859 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:07.305093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:07.579240 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:07.587206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7b1541a6-ae9f-4370-a9b6-4f29365d2877 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.312939 Jun 07 04:53:07.588415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 247/497] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:07 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:07.627308 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:07.638289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5ab9f6d1-bb93-4a89-8d39-fc643935adbf tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1722 microversion: 2.1 time: 0.387701 Jun 07 04:53:07.638879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 251/498] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:07 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1722 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:08.604951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:08.605595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:08.622691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.625856 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.627354 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.628114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.655112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:08.656366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:08.663593 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.664208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.665135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.665707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.688095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:08.911774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:08.918441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:08.924872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8ea6b24b-6804-462e-bb35-e08d89415d03 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.324424 Jun 07 04:53:08.926185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 248/499] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:08 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:08.928236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f6ff6735-ed28-4572-9e70-bd91cf30461a tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1728 microversion: 2.1 time: 0.277024 Jun 07 04:53:08.929822 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 252/500] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:08 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1728 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:08.948399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:08.949677 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:08.956496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.957302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.958860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:08.959715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:08.985451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:09.057492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-29017274-9d3e-49a8-b9b6-d03c5526ec6e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114723 Jun 07 04:53:09.058713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 249/501] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 04:53:08 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:09.942500 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:09.943116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:09.950511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:09.950959 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:09.952237 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:09.952819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:10.166310 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:10.178025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fb8f9dc4-a891-4a7b-8365-54a95c5704eb tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.239211 Jun 07 04:53:10.184314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 253/502] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:09 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:10.322258 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-f0898cdc-d19a-4f32-bf21-84b56696f34a req-bf01d09b-f96b-4a66-98b7-52760eb27d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:10.333030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f0898cdc-d19a-4f32-bf21-84b56696f34a req-bf01d09b-f96b-4a66-98b7-52760eb27d92 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:10.334197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f0898cdc-d19a-4f32-bf21-84b56696f34a req-bf01d09b-f96b-4a66-98b7-52760eb27d92 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:10.354042 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-f0898cdc-d19a-4f32-bf21-84b56696f34a req-bf01d09b-f96b-4a66-98b7-52760eb27d92 service nova] Creating event network-changed:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:53:10.361624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-f0898cdc-d19a-4f32-bf21-84b56696f34a req-bf01d09b-f96b-4a66-98b7-52760eb27d92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295926 Jun 07 04:53:10.362430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 250/503] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:11.197594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:11.199459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:11.205847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=31 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:11.207760 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:11.208553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:11.209764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:11.210835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:11.391340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:11.400741 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b891d7ac-70ad-4b5e-86c0-32e9150adbc7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.207932 Jun 07 04:53:11.402868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 254/504] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:11 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:12.378458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-5719892a-2202-400a-8f83-fa3e20cd59d1 req-b9257724-4899-4a9b-a7b7-46f03def1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:12.389138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-5719892a-2202-400a-8f83-fa3e20cd59d1 req-b9257724-4899-4a9b-a7b7-46f03def1d39 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:12.390051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-5719892a-2202-400a-8f83-fa3e20cd59d1 req-b9257724-4899-4a9b-a7b7-46f03def1d39 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:12.402602 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-5719892a-2202-400a-8f83-fa3e20cd59d1 req-b9257724-4899-4a9b-a7b7-46f03def1d39 service nova] Creating event network-changed:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:53:12.409345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-5719892a-2202-400a-8f83-fa3e20cd59d1 req-b9257724-4899-4a9b-a7b7-46f03def1d39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034811 Jun 07 04:53:12.415625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 251/505] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:12.419621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:12.420562 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:12.433860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:12.434478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:12.435370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:12.436542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:12.720992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:12.730007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-436ef6b3-4187-4efa-bfb3-3dfa8f23c45a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.314439 Jun 07 04:53:12.731442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 255/506] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:12 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:13.751174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:13.752691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:13.760441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:13.760894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:13.761869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:13.762551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:13.935055 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:13.946722 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-458839f2-9d28-4335-9c31-f9861cc927d9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1675 microversion: 2.1 time: 0.197275 Jun 07 04:53:13.947881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 252/507] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:13 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:14.963909 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:14.965206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:14.972392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:14.973198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:14.974042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:14.974990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:15.123133 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:15.132846 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-809a7e74-7643-4471-9b1e-ee3ff6069b6e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1652 microversion: 2.1 time: 0.172181 Jun 07 04:53:15.133462 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 256/508] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:14 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1652 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:15.149300 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6498f7fa-8d61-4807-a70a-89eb1e23fa27 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:15.156621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6498f7fa-8d61-4807-a70a-89eb1e23fa27 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:15.157065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6498f7fa-8d61-4807-a70a-89eb1e23fa27 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:15.222165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6498f7fa-8d61-4807-a70a-89eb1e23fa27 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Going to try to start instance {{(pid=124421) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 04:53:15.272432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6498f7fa-8d61-4807-a70a-89eb1e23fa27 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action" status: 202 len: 0 microversion: 2.1 time: 0.126837 Jun 07 04:53:15.273594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 253/509] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:53:15 2022] POST /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:53:15.287721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:15.289139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:15.300671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:15.301116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:15.301928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:15.302379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:15.471454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:15.484999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8750e92e-ae4c-428e-b006-2dea7f1ae6b5 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1661 microversion: 2.1 time: 0.207155 Jun 07 04:53:15.487611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 257/510] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:15 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:16.505843 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:16.506409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:16.515015 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:16.515733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:16.516686 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:16.517307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:16.691962 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:16.700293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-80574cc0-9dc3-4cde-9d7c-f991adcd4a80 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1661 microversion: 2.1 time: 0.198744 Jun 07 04:53:16.701456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 254/511] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:16 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1661 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:17.720183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:17.720908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:17.728173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:17.728620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:17.729417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:17.729853 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:17.888292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:17.896278 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-652c2a49-452a-4667-bb45-b840c653ea4c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1665 microversion: 2.1 time: 0.179893 Jun 07 04:53:17.896835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 258/512] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:17 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:19.282985 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8ab261c1-a235-4418-bcda-c17073408fb2 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'create', calling method: .version_select at 0x7f3d5dcdcd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-275257582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNr8lWz7+ZVxT3zxlKV4VvSFhfaqYEZ0RZUZPq3wVz0i7oh8nZFcVuiOW8qXOBJoNS6M7f+BySgTcK8vFmx78WowScTa+1fyRUdMHv52OHbZ3l6K/yX3qrtRdg5I1oifw=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:19.287519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=39 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:19.299192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-8ab261c1-a235-4418-bcda-c17073408fb2 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Getting quotas for project 577dff55add94455a42bb2dd447bb889. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:53:19.302975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-8ab261c1-a235-4418-bcda-c17073408fb2 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Getting quotas for user b09498db46e54118ba65ed54c7cff650 and project 577dff55add94455a42bb2dd447bb889. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:53:19.328756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8ab261c1-a235-4418-bcda-c17073408fb2 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049632 Jun 07 04:53:19.329382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 255/513] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:53:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:19.378898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-880882792", "imageRef": "442a8830-efbd-4fd0-9b18-6504db24a062", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-275257582", "networks": [{"uuid": "9e3af12d-1706-4ec0-a354-4d465e06be96"}]}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:19.429204 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] validate_networks() for [('9e3af12d-1706-4ec0-a354-4d465e06be96', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:53:19.890801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:53:19.891225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:53:19.891700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:53:19.892110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:53:19.892520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:53:19.902072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:19.902521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:19.903314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:19.903747 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:19.920318 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Getting quotas for project 577dff55add94455a42bb2dd447bb889. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:53:19.924193 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Getting quotas for user b09498db46e54118ba65ed54c7cff650 and project 577dff55add94455a42bb2dd447bb889. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:53:19.935571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:53:19.937779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='442a8830-efbd-4fd0-9b18-6504db24a062',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:53:19.985068 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-eba02998-3322-46c8-b439-55a5070dc1b5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609995 Jun 07 04:53:19.985738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 259/514] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:53:19.996033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-31aa4939-0255-4498-a11a-e9e75aa5ecc7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:19.996644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-31aa4939-0255-4498-a11a-e9e75aa5ecc7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:20.053622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31aa4939-0255-4498-a11a-e9e75aa5ecc7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:20.061183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-31aa4939-0255-4498-a11a-e9e75aa5ecc7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1257 microversion: 2.1 time: 0.068926 Jun 07 04:53:20.061769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 256/515] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:19 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:21.079277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:21.079920 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:21.088364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:21.089198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:21.090026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:21.090471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:21.154768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:21.165203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4624f6ba-7f75-4e8f-8f5d-dd6e92e6e6fa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1317 microversion: 2.1 time: 0.089849 Jun 07 04:53:21.166042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 260/516] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:21 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1317 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:22.182259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:22.182886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:22.190411 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:22.190855 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:22.191617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:22.192043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:22.365057 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:22.375528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-09290c1f-ecbd-4568-86a7-270aed52ecaa tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.197138 Jun 07 04:53:22.376455 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 257/517] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:22 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:23.393593 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:23.394223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:23.402383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:23.402834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:23.403617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:23.404054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:23.547908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:23.556559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f23227a-5987-4b29-a5c2-b9639be3a756 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.166739 Jun 07 04:53:23.557345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 261/518] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:23 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:24.572629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:24.573297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:24.579942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:24.580652 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:24.581677 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:24.582264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:24.753552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:24.761802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f815c89a-730c-4820-be44-193d1450b662 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.193068 Jun 07 04:53:24.762381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 258/519] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:24 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:25.778560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:25.779193 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:25.785957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:25.786405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:25.787168 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:25.788197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:25.937830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:25.947401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b3e272d5-1dfa-41f0-802e-dd206fb51395 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.172439 Jun 07 04:53:25.948107 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 262/520] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:25 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:26.536061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:26.536761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:26.544030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.544833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:26.545865 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.546516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:26.586980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:53:26.685594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0088664d-5310-4478-8d6d-511bf8452b4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 204 len: 0 microversion: 2.1 time: 0.269823 Jun 07 04:53:26.686227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 259/521] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:53:26 2022] DELETE /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:53:26.694842 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:26.695674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:26.702900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.703442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:26.704310 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.704814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:26.843735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:26.851658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-10093e14-bf12-49ea-98d2-3bbbcae7801f tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.161146 Jun 07 04:53:26.852560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 263/522] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:26 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:26.965076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:26.965854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:26.972210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.972661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:26.973469 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:26.973910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:27.334088 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:27.342330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4081e316-a2bb-4a18-bba0-3ee4c3de3f91 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.381621 Jun 07 04:53:27.342912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 260/523] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:26 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:27.871024 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:27.871765 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:27.885967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:27.886730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:27.887824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:27.888308 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:28.039054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:28.046718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-39f80120-18e2-4e10-be17-477f71574277 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.181286 Jun 07 04:53:28.047501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 264/524] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:27 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:28.359546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:28.360828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:28.382894 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:28.383342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:28.384116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:28.384542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:28.540035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:28.549488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bbbcdb44-aadf-411a-9e97-943cec16894b tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.193771 Jun 07 04:53:28.553419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 261/525] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:28 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:29.064021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:29.064734 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:29.071930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:29.072624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:29.073460 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:29.073900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:29.219050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:29.226675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f93bd320-cfb2-4232-bb9e-56a229dae826 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.166511 Jun 07 04:53:29.227240 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 265/526] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:29 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:29.567800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:29.568418 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:29.575368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:29.575795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:29.576689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:29.577158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:29.709600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:29.716983 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-65239e2f-9114-4669-92eb-f0be9803e983 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.153031 Jun 07 04:53:29.717572 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 262/527] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:29 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:30.244863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:30.245510 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:30.247629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:30.248373 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:30.254524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:30.254980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:30.255746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:30.256217 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:30.387707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:30.395207 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ceea5c04-1ba3-4fe7-ae92-d5446a8d6c58 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.155231 Jun 07 04:53:30.395769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 266/528] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:30 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:30.733376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:30.733910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:30.735833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:30.742111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:30.742553 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:30.743311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:30.743741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:30.870554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:30.878244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cee822aa-8817-40fe-8fd7-93cbffd59fb6 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.148769 Jun 07 04:53:30.878784 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 263/529] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:30 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:31.412647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:31.413300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:31.419907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:31.420405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:31.421215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:31.421695 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:31.563146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:31.571411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b2345641-7ab4-4fc9-9b4c-1b72a662de2a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.162986 Jun 07 04:53:31.571979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 267/530] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:31 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:31.895045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:31.895682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:31.902191 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:31.902651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:31.903393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:31.903822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:32.031775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:32.039826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b45a589c-25be-4e17-abe7-942cddf386f4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.148555 Jun 07 04:53:32.040387 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 264/531] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:31 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:32.588871 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:32.589494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:32.595941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:32.596389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:32.597144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:32.597610 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:32.738721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:32.746422 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-183b8d85-137c-45b6-924b-3724412b466c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.162081 Jun 07 04:53:32.747230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 268/532] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:32 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:33.056667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:33.057297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:33.063772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:33.064218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:33.065034 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:33.065494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:33.198229 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:33.206157 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-13be3b61-3ded-4623-98f1-72cf26f1c420 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.154055 Jun 07 04:53:33.206782 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 265/533] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:33 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:33.762772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:33.763649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:33.770583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:33.771149 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:33.772953 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:33.773526 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:33.915743 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:33.919243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:33.924895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f04017cb-4264-4346-bef9-382930f6d08a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.165969 Jun 07 04:53:33.941257 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 269/534] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:33 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:34.059577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-f17be625-cd8c-4c96-896d-1263aa49f984 req-a82600e2-2994-4dcf-8b54-806f0f833594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:34.068910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f17be625-cd8c-4c96-896d-1263aa49f984 req-a82600e2-2994-4dcf-8b54-806f0f833594 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:34.069888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f17be625-cd8c-4c96-896d-1263aa49f984 req-a82600e2-2994-4dcf-8b54-806f0f833594 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:34.083543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-f17be625-cd8c-4c96-896d-1263aa49f984 req-a82600e2-2994-4dcf-8b54-806f0f833594 service nova] Creating event network-changed:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:53:34.088990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-f17be625-cd8c-4c96-896d-1263aa49f984 req-a82600e2-2994-4dcf-8b54-806f0f833594 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Jun 07 04:53:34.089811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 266/535] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:34.223376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:34.223987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:34.230725 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:34.231166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:34.231914 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:34.232344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:34.361355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:34.368791 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8aa0b2a0-d151-4697-862a-e957cd0f0480 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.149184 Jun 07 04:53:34.369314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 270/536] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:34 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:35.001584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:35.002218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:35.008897 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:35.009468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:35.010220 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:35.010657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:35.139460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:35.143039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:35.148622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-70ecaba4-a32c-4ae2-9267-b7c3950a8f9d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.151552 Jun 07 04:53:35.149178 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 267/537] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:34 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:35.387025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:35.387765 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:35.395207 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:35.395641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:35.396962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:35.397450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:35.531416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:35.539606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c35e8924-9042-4658-9c9c-086296e15294 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.157556 Jun 07 04:53:35.540184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 271/538] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:35 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:36.166464 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:36.167181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:36.174521 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:36.174972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:36.175740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:36.176176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:36.321201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:36.329023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4dac1eb0-e514-492f-98ec-d6b0f5c58250 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1577 microversion: 2.1 time: 0.167366 Jun 07 04:53:36.329912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 268/539] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:36 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:36.557119 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:36.557914 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:36.564489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:36.565139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:36.566126 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:36.566761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:36.627247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-e398ac05-ce7c-49c9-b044-eb6f9d11b44d req-82e4edfb-5acd-4e21-8135-08fb9fe8cc41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3413578b-b03f-4a2b-b8a8-4f8515da19e2", "name": "network-vif-deleted", "tag": "483abe59-eaa4-4119-a55c-abfa1e9a4fd8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:36.633313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e398ac05-ce7c-49c9-b044-eb6f9d11b44d req-82e4edfb-5acd-4e21-8135-08fb9fe8cc41 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:36.633764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e398ac05-ce7c-49c9-b044-eb6f9d11b44d req-82e4edfb-5acd-4e21-8135-08fb9fe8cc41 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:36.647135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-e398ac05-ce7c-49c9-b044-eb6f9d11b44d req-82e4edfb-5acd-4e21-8135-08fb9fe8cc41 service nova] Creating event network-vif-deleted:483abe59-eaa4-4119-a55c-abfa1e9a4fd8 for instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 on hv-cinder-83699 Jun 07 04:53:36.652546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-e398ac05-ce7c-49c9-b044-eb6f9d11b44d req-82e4edfb-5acd-4e21-8135-08fb9fe8cc41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031683 Jun 07 04:53:36.656188 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 269/540] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:36.732787 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:36.742484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1ff2a4f3-fa56-48db-aade-e539eae296bd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.189828 Jun 07 04:53:36.743165 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 272/541] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:36 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:37.346909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:37.347926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:37.355243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:37.355691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:37.356483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:37.356917 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:37.422582 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:37.430883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-842a0a04-da79-4a73-8981-876e5f7d9e1c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1509 microversion: 2.1 time: 0.088238 Jun 07 04:53:37.440212 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 270/542] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:37 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1509 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:37.760125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:37.760847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:37.767004 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:37.767524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:37.768352 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:37.768888 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:37.901952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:37.909314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9039c0a-ab07-48af-bf8d-8f8becac02a7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.153563 Jun 07 04:53:37.909877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 273/543] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:37 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:38.448634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:38.449368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:38.455768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:38.456190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:38.456945 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:38.457441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:38.523075 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:38.530515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0f1df92c-5092-4a5c-a61a-d0e66319ae74 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 200 len: 1509 microversion: 2.1 time: 0.085826 Jun 07 04:53:38.531081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 271/544] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:38 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 1509 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:38.926698 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:38.928074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:38.935398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:38.935916 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:38.936758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:38.937317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:39.076280 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:39.084029 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3ac679c9-1b45-411b-82e7-2566b40cb8e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.161283 Jun 07 04:53:39.084599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 274/545] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:38 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:39.547498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:39.548076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:39.555431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:39.555907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:39.556669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:39.557099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:39.571711 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] HTTP exception thrown: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Request method failure captured: Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 HTTP/1.1 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintiGHeKvNWwTSZ14-ILMqXtpJdMjV04BpmRvYBnSdKEmkzYsNXWxPOs4TRmMQm9j4hxDpczh89ILWMvqcuWuyJzE5t0ug7ElFjeixRjBCRKBLnRv5cSLjltRPNPj9ZEPxx-HyxMcdzbAGcYW2q7e_PlT4oqY1DKppiJEvXzBAqW_ns0 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:53:39.573389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e03f0a90584400b80b912510f02a228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e03f0a90584400b80b912510f02a228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}] Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-TestVolumeBootPattern-477187217 Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: c4a16db9150f433e9b40545a7e68f2c5 Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:53:39.574791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '3413578b-b03f-4a2b-b8a8-4f8515da19e2'} Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:53:39.575826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:53:39.579053 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:53:39.581313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Returning 404 to user: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:53:39.581313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-737a4244-49f8-477d-8f0e-909cf8ea2cbb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 404 len: 111 microversion: 2.1 time: 0.031488 Jun 07 04:53:39.581313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 272/546] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:39 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:53:39.636925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-252502866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1404641648", "security_groups": [{"name": "tempest-secgroup-smoke-1820215520"}], "block_device_mapping_v2": [{"uuid": "de530cd6-e089-4e73-abe2-ab14d65b4138", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a9cdced-d65a-4ad0-9d69-4961d1237297"}]}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:39.752359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] validate_networks() for [('3a9cdced-d65a-4ad0-9d69-4961d1237297', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:53:40.100742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:40.101466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:40.107513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:40.107973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:40.108755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:40.109194 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:40.121054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:53:40.121568 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:53:40.122212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:53:40.122611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:53:40.123013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:53:40.132401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:40.132846 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:40.133664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:40.134092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:40.151415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:53:40.155437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for user c4a16db9150f433e9b40545a7e68f2c5 and project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:53:40.214364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:53:40.216391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de530cd6-e089-4e73-abe2-ab14d65b4138',volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:53:40.245026 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:40.252741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2b012937-56ab-4b10-9eb5-c7ec3485b3e4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.156255 Jun 07 04:53:40.253324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 273/547] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:40 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:40.343470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cc3f9390-9252-409c-a525-c1611ec55fdb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710419 Jun 07 04:53:40.344304 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 275/548] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:53:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:53:40.355163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-333c3700-79a2-4f62-a19c-aa47b52610ca tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:40.355772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-333c3700-79a2-4f62-a19c-aa47b52610ca tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:40.408937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-333c3700-79a2-4f62-a19c-aa47b52610ca tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:40.416211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-333c3700-79a2-4f62-a19c-aa47b52610ca tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1094 microversion: 2.1 time: 0.064952 Jun 07 04:53:40.416772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 274/549] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:40 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:41.270256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:41.272010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:41.275754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:41.279657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:41.280112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:41.280886 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:41.281356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:41.429339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:41.433305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:41.434610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:41.441369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7878ccb3-b2be-4c98-b2de-fb9fa0276a97 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.174646 Jun 07 04:53:41.444045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:41.444994 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:41.446005 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:41.446819 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:41.465092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 276/550] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:41 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:41.520821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:41.529447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ea2d03e8-4ce1-4424-9f1a-6051f48e35a4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1210 microversion: 2.1 time: 0.100431 Jun 07 04:53:41.530044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 275/551] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:41 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:42.460531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:42.461136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:42.467613 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:42.468069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:42.468837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:42.469297 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:42.547087 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:42.547696 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:42.554717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:42.555171 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:42.556112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:42.556716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:42.648773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:42.658354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5feded70-599f-4f32-b328-e7471b8d631f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.202193 Jun 07 04:53:42.659037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 277/552] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:42 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:42.718957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:42.727235 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f1e14196-8829-4f46-86df-b3ab08a00a5c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.183910 Jun 07 04:53:42.727824 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 276/553] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:42 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:42.873836 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-cd13877c-67f4-444b-950f-f69bec868c12 req-00c5f88c-8b8f-4175-900a-7e8c88adf312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48f8409-8c4e-48de-a7e4-fa5cee12d801", "tag": "b435d72a-57d6-489d-9f94-452de03d3264"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:42.888716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-cd13877c-67f4-444b-950f-f69bec868c12 req-00c5f88c-8b8f-4175-900a-7e8c88adf312 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:42.889268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-cd13877c-67f4-444b-950f-f69bec868c12 req-00c5f88c-8b8f-4175-900a-7e8c88adf312 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:42.906333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-cd13877c-67f4-444b-950f-f69bec868c12 req-00c5f88c-8b8f-4175-900a-7e8c88adf312 service nova] Creating event network-changed:b435d72a-57d6-489d-9f94-452de03d3264 for instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 on hv-cinder-83699 Jun 07 04:53:42.911434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-cd13877c-67f4-444b-950f-f69bec868c12 req-00c5f88c-8b8f-4175-900a-7e8c88adf312 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042240 Jun 07 04:53:42.913040 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 278/554] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:43.432728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-f23a2551-5f8d-4c4c-a972-80e7f3498f2a req-a776d2f9-4923-43c8-a7aa-fa0089453ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "name": "network-vif-plugged", "status": "completed", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:43.441035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f23a2551-5f8d-4c4c-a972-80e7f3498f2a req-a776d2f9-4923-43c8-a7aa-fa0089453ecc service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:43.441528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-f23a2551-5f8d-4c4c-a972-80e7f3498f2a req-a776d2f9-4923-43c8-a7aa-fa0089453ecc service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:43.453265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-f23a2551-5f8d-4c4c-a972-80e7f3498f2a req-a776d2f9-4923-43c8-a7aa-fa0089453ecc service nova] Creating event network-vif-plugged:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:53:43.458316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-f23a2551-5f8d-4c4c-a972-80e7f3498f2a req-a776d2f9-4923-43c8-a7aa-fa0089453ecc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092782 Jun 07 04:53:43.459442 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 277/555] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:43.675378 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:43.675980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:43.683511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:43.683957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:43.684718 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:43.685149 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:43.745927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:43.746645 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:43.753622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:43.754067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:43.754916 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:43.755416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:43.861924 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:43.870380 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ee18e007-9012-42ce-8fe6-e408205da2c5 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.199730 Jun 07 04:53:43.870950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 279/556] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:43 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:43.907778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:43.915384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-49ff5027-618f-4e0e-a277-bef2193a71eb tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.174199 Jun 07 04:53:43.915946 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 278/557] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:43 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:44.887222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:44.887840 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:44.894366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:44.894757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:44.895507 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:44.896420 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:44.931724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:44.932330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:44.938909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:44.939358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:44.940133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:44.940566 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:45.080039 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:45.087984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ba23055a-6532-4ff3-8dce-9764b8472c73 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.204573 Jun 07 04:53:45.088553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 280/558] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:44 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:45.112663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:45.120107 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6af3c42a-5ca1-4dc8-b35a-9604581376f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.192150 Jun 07 04:53:45.120664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 279/559] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:44 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:46.104532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:46.105137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:46.111537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:46.111982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:46.112730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:46.113159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:46.135961 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:46.136564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:46.142934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:46.143384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:46.144137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:46.144565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:46.300823 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:46.309212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-735a1b07-3d11-495c-8c63-a6d65c47d6b8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1357 microversion: 2.1 time: 0.208474 Jun 07 04:53:46.309935 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 281/560] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:46 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:46.329123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:46.338285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b007c976-469c-4081-9a78-60ca923022f2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.206012 Jun 07 04:53:46.339109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 280/561] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:46 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:47.325643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:47.326336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:47.332727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.333172 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.334258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.334767 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.355517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:47.356583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:47.363045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.363503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.364268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.365260 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.526934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:47.534417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c668c8e3-5b46-4108-b0bb-21a31324f64a tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1547 microversion: 2.1 time: 0.212592 Jun 07 04:53:47.535144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 282/562] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:47 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1547 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:47.543211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:47.550685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c611960e-1f98-4829-beb3-08ebbf1766e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.198978 Jun 07 04:53:47.550834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:47.551247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 281/563] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:47 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:47.551390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:47.558087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.558536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.559298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.559735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.689083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:47.696342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-610d7530-a8ed-4a9c-841e-9e840116bc0d tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1547 microversion: 2.1 time: 0.149260 Jun 07 04:53:47.696904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 283/564] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:47 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:47.712090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:47.715495 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:47.716296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Searching by: {'deleted': False, 'project_id': '577dff55add94455a42bb2dd447bb889'} {{(pid=124421) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 04:53:47.722920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.723372 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.724663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.725098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.817405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.multi_cell_list [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124421) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 04:53:47.913310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2376a1c4-8c3e-44f6-ac4a-5d6e4c77d069 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204767 Jun 07 04:53:47.913823 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 282/565] 10.222.0.40 () {58 vars in 1124 bytes} [Tue Jun 7 04:53:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:47.923877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:47.924490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:47.931017 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.931465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:47.932222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:47.932655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:48.060790 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:48.068483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9d422ab-ad7e-4df5-9adc-cf1f5c22be74 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1547 microversion: 2.1 time: 0.148391 Jun 07 04:53:48.069048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 284/566] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:47 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:48.568517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:48.569176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:48.575535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:48.576011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:48.576762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:48.577193 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:48.707672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:48.715358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4d86863c-abaa-4f73-9035-8c3163b69d79 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.151368 Jun 07 04:53:48.715926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 283/567] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:48 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:49.572912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb14534-e445-4f8c-ac7a-89a181ca84c5"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:49.574012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:49.580432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:49.580881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:49.581659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:49.582096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:49.730951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:49.731569 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:49.734055 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:49.739276 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:49.739896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:49.740680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:49.741123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:49.885375 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:49.892702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-362a457b-37f2-49b5-a899-0f1331c9801d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.165581 Jun 07 04:53:49.893294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 284/568] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:49 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:50.141556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:50.162305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:50.909293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:50.909911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:50.911878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:50.918667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:50.919198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:50.920045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:50.920550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:50.955970 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3717198b-e7bd-4595-b7fb-25ae2babbe75 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.386730 Jun 07 04:53:50.962378 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 285/569] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:53:49 2022] POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments => generated 194 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:51.100488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:51.107792 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-356adbe6-c622-42aa-8249-33d165df30a6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.202443 Jun 07 04:53:51.108359 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 285/570] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:50 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:53:52.127258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:52.127881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:52.135957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:52.136511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:52.137303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:52.137735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:52.157772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:52.294289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:52.303729 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-608d68a5-c55c-46c7-9265-7058efeed1e1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.180866 Jun 07 04:53:52.304300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 286/571] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:52 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:53.322221 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:53.322922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:53.328801 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:53.329343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:53.330109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:53.330542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:53.472707 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:53.480845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-22e914de-1372-408e-a665-d87e6854769b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.163754 Jun 07 04:53:53.481545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 286/572] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:53 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:54.498481 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:54.499022 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:54.506216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:54.506884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:54.507828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:54.508453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:54.646208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:54.653691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4b0610ea-37f5-45b9-9fda-68e4c0057807 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.159314 Jun 07 04:53:54.654249 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 287/573] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:54 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:55.549921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-5d7a550b-8a91-477d-bd8c-603572129da1 req-b3019e62-e7a6-469b-8bfd-ed0ded4b204b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48f8409-8c4e-48de-a7e4-fa5cee12d801", "name": "network-vif-plugged", "status": "completed", "tag": "b435d72a-57d6-489d-9f94-452de03d3264"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:53:55.559000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-5d7a550b-8a91-477d-bd8c-603572129da1 req-b3019e62-e7a6-469b-8bfd-ed0ded4b204b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:55.559445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-5d7a550b-8a91-477d-bd8c-603572129da1 req-b3019e62-e7a6-469b-8bfd-ed0ded4b204b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:55.563732 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:55.571781 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-5d7a550b-8a91-477d-bd8c-603572129da1 req-b3019e62-e7a6-469b-8bfd-ed0ded4b204b service nova] Creating event network-vif-plugged:b435d72a-57d6-489d-9f94-452de03d3264 for instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 on hv-cinder-83699 Jun 07 04:53:55.576653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-5d7a550b-8a91-477d-bd8c-603572129da1 req-b3019e62-e7a6-469b-8bfd-ed0ded4b204b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030666 Jun 07 04:53:55.577432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 287/574] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:53:55.669816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:55.670459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:55.677887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:55.678340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:55.679104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:55.679536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:55.812625 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:55.821203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-16640223-f630-40f0-8716-58e7e09fb298 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.155257 Jun 07 04:53:55.821805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 288/575] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:55 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:56.838958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:56.839680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:56.845811 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:56.846264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:56.847019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:56.847451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:56.980306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:56.987719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1181d6a1-48db-4f46-bc9d-94b7050d88c4 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1266 microversion: 2.1 time: 0.153454 Jun 07 04:53:56.988284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 288/576] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:56 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:58.005370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:58.005898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:58.012434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:58.012875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:58.013659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:58.014088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:58.146720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:58.154245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4a34d79e-a3c2-473c-b057-a1436fac9d3d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1454 microversion: 2.1 time: 0.152887 Jun 07 04:53:58.154849 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 289/577] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:58 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:58.170571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:58.171175 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:58.173104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:53:58.179737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:58.180181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:58.180942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:58.181399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:58.316787 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:58.325019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a5855f22-d280-457c-ac10-9cdce5e58a87 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1454 microversion: 2.1 time: 0.158070 Jun 07 04:53:58.325653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 289/578] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:58 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:53:59.583311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:53:59.584422 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:53:59.593745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:59.594193 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:59.594961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:53:59.595409 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:53:59.931009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:53:59.939146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2320d5b8-aafa-4a5e-afa1-825dd75d0d65 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1593 microversion: 2.1 time: 0.359953 Jun 07 04:53:59.939867 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 290/579] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:53:59 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1593 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:00.265406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-7cfb6638-89d5-42e7-80d2-6d93918b0712 req-821097f2-36c1-421d-bc9a-249eede84f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48f8409-8c4e-48de-a7e4-fa5cee12d801", "tag": "b435d72a-57d6-489d-9f94-452de03d3264"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:00.275262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-7cfb6638-89d5-42e7-80d2-6d93918b0712 req-821097f2-36c1-421d-bc9a-249eede84f2c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:00.275895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-7cfb6638-89d5-42e7-80d2-6d93918b0712 req-821097f2-36c1-421d-bc9a-249eede84f2c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:00.288073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-7cfb6638-89d5-42e7-80d2-6d93918b0712 req-821097f2-36c1-421d-bc9a-249eede84f2c service nova] Creating event network-changed:b435d72a-57d6-489d-9f94-452de03d3264 for instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 on hv-cinder-83699 Jun 07 04:54:00.293826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-7cfb6638-89d5-42e7-80d2-6d93918b0712 req-821097f2-36c1-421d-bc9a-249eede84f2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Jun 07 04:54:00.294436 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 290/580] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:02.388864 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-b0d25d83-a67f-411a-a3c9-f65b6ef1ebf7 req-9ab4f204-158f-45e2-a201-32fef7643fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:02.398887 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-b0d25d83-a67f-411a-a3c9-f65b6ef1ebf7 req-9ab4f204-158f-45e2-a201-32fef7643fef service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:02.399337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-b0d25d83-a67f-411a-a3c9-f65b6ef1ebf7 req-9ab4f204-158f-45e2-a201-32fef7643fef service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:02.412230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-b0d25d83-a67f-411a-a3c9-f65b6ef1ebf7 req-9ab4f204-158f-45e2-a201-32fef7643fef service nova] Creating event network-changed:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:54:02.417647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-b0d25d83-a67f-411a-a3c9-f65b6ef1ebf7 req-9ab4f204-158f-45e2-a201-32fef7643fef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032437 Jun 07 04:54:02.418234 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 291/581] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:03.718067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1703768554"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:03.718688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:03.725876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:03.726353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:03.727116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:03.727551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:03.853245 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.network.security_group_api [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Adding security group f6a06d19-c2e7-4a93-8ba0-dd4200bb417e to port faf6ae1f-31de-4216-9e3d-668d20acd9b8 Jun 07 04:54:04.271759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f593891d-a670-4965-b82e-201f26bb38fd tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action" status: 202 len: 0 microversion: 2.1 time: 0.559695 Jun 07 04:54:04.273754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 291/582] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:54:03 2022] POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:54:04.286683 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:04.288035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:04.292843 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-a8cf3935-fa0e-4f11-827e-e22e3d4f012f req-3798515e-2d01-4239-ab33-68c806036c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:04.308544 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:04.308781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:04.309529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:04.311525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a8cf3935-fa0e-4f11-827e-e22e3d4f012f req-3798515e-2d01-4239-ab33-68c806036c2f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:04.311977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a8cf3935-fa0e-4f11-827e-e22e3d4f012f req-3798515e-2d01-4239-ab33-68c806036c2f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:04.316646 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:04.329273 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-a8cf3935-fa0e-4f11-827e-e22e3d4f012f req-3798515e-2d01-4239-ab33-68c806036c2f service nova] Creating event network-changed:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:54:04.335563 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-a8cf3935-fa0e-4f11-827e-e22e3d4f012f req-3798515e-2d01-4239-ab33-68c806036c2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052155 Jun 07 04:54:04.341162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 292/583] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:04.503170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:04.516132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c3d2f6b3-054a-40e5-896e-d4be1448ab44 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1758 microversion: 2.1 time: 0.238241 Jun 07 04:54:04.516997 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 292/584] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:04 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:14.488631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=17 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:14.490381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=20 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:14.495976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:14.496822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:14.503927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:14.504382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:14.505170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:14.505635 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:14.586200 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lazy-loading 'services' on Instance uuid 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:54:14.656951 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-00b755a2-2801-496e-9196-957d21e76e84 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments/a8708bf5-6b56-4412-ae1e-bedea60d6606" status: 202 len: 0 microversion: 2.1 time: 0.169865 Jun 07 04:54:14.657607 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 293/585] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:54:14 2022] DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments/a8708bf5-6b56-4412-ae1e-bedea60d6606 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 04:54:14.666761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:14.667717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:14.670330 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=33 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:14.670990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=34 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:14.678598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:14.679056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:14.679835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:14.680278 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:14.712862 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0e02104a-9f2b-4eaa-9e65-7c2ffafce9de tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Jun 07 04:54:14.713991 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 293/586] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:54:14 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:15.725379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:15.726598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:15.732720 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:15.733110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:15.733907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:15.734342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:15.767601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2dbe28e2-f8f0-4c7f-b702-1300b5a9ad79 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Jun 07 04:54:15.768154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 294/587] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:54:15 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:16.780108 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:16.781088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:16.787561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:16.788012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:16.788780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:16.789215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:16.816549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-32b0d807-32cb-4307-8f1b-8fd2db2272c5 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040394 Jun 07 04:54:16.817099 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 294/588] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:54:16 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:54:16.886429 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:16.886924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:16.893413 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:16.893868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:16.894638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:16.895078 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:16.923437 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:54:16.995830 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cc6d6950-828d-446e-aba2-a7122a5c7379 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 204 len: 0 microversion: 2.1 time: 0.112936 Jun 07 04:54:16.996654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 295/589] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:54:16 2022] DELETE /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:54:17.004835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:17.005937 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:17.012103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:17.012551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:17.013344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:17.013810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:17.146922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:17.154291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e37a84dd-6e0e-494e-b185-113a5eb23047 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1688 microversion: 2.1 time: 0.153263 Jun 07 04:54:17.154881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 295/590] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:16 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:18.172500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:18.173197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:18.180415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:18.180890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:18.181684 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:18.182120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:18.310388 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:18.318454 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a3297fe2-5805-43bc-ba90-c1ef2c0012b2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1688 microversion: 2.1 time: 0.150124 Jun 07 04:54:18.319047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 296/591] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:18 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:19.336196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:19.336808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:19.343345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:19.343793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:19.344554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:19.344993 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:19.471717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:19.479125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f4452fca-28f1-4a4a-8d8b-c51dbd0e4aab tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1688 microversion: 2.1 time: 0.147705 Jun 07 04:54:19.479694 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 296/592] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:19 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:20.496580 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:20.497761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:20.509733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:20.510221 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:20.511040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:20.511548 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:20.643500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:20.652103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9d5c7f2e-d36f-4590-a26a-a02730d799c2 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1688 microversion: 2.1 time: 0.160047 Jun 07 04:54:20.652685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 297/593] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:20 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:21.673709 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:21.674367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:21.681423 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.682042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.686984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.686984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.746119 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:21.747439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:21.753845 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:21.754466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.755007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.755989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.756664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.761990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-07536140-389d-4805-88dd-9657740174e9 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1621 microversion: 2.1 time: 0.096521 Jun 07 04:54:21.762580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 297/594] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:21 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:21.788503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-71bc754d-941b-4382-964f-7d6002a26ea3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046346 Jun 07 04:54:21.789165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 298/595] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:54:21 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 04:54:21.845998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:21.846494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:21.853174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.853664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.854437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.854881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.882784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:54:21.939125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-82a40e60-23cd-434a-8328-3e0d9928d9f2 req-4e683796-340a-451f-9e12-7b478376dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f", "name": "network-vif-deleted", "tag": "a33f63bb-a301-495c-941e-1ea86608c3c2"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:21.948320 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-82a40e60-23cd-434a-8328-3e0d9928d9f2 req-4e683796-340a-451f-9e12-7b478376dc38 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:21.948839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-82a40e60-23cd-434a-8328-3e0d9928d9f2 req-4e683796-340a-451f-9e12-7b478376dc38 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:21.961774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-82a40e60-23cd-434a-8328-3e0d9928d9f2 req-4e683796-340a-451f-9e12-7b478376dc38 service nova] Creating event network-vif-deleted:a33f63bb-a301-495c-941e-1ea86608c3c2 for instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f on hv-cinder-83699 Jun 07 04:54:21.967430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-82a40e60-23cd-434a-8328-3e0d9928d9f2 req-4e683796-340a-451f-9e12-7b478376dc38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Jun 07 04:54:21.974935 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 299/596] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:54:21.980073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b5f659e2-2b3d-463f-89c7-7cc560b9f2d7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 204 len: 0 microversion: 2.1 time: 0.137347 Jun 07 04:54:21.984214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 298/597] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:54:21 2022] DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:54:21.990813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:21.991772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:22.000684 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:22.001204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:22.002559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:22.002559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:22.150249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:22.158120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8772d5da-9efb-4ba4-8405-a648c9eb1056 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1671 microversion: 2.1 time: 0.172063 Jun 07 04:54:22.159114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 300/598] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:21 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:22.779850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:22.780557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:22.787236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:22.787686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:22.788462 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:22.788901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:22.851816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:22.861470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e8bb079a-ee44-4b9c-a21d-4eae543c12be tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 200 len: 1329 microversion: 2.1 time: 0.085697 Jun 07 04:54:22.862262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 299/599] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:22 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:23.177768 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:23.178310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:23.184378 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:23.184822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:23.185611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:23.186048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:23.313800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:23.321996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d13f110c-3a03-4db7-8194-d938174ac29c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1671 microversion: 2.1 time: 0.148714 Jun 07 04:54:23.322564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 301/600] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:23 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:23.878798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:23.879453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:23.887300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:23.887756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:23.888529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:23.888969 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:23.902951 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] HTTP exception thrown: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Request method failure captured: Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f HTTP/1.1 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthP1FPaEHk91cJ2SUPblGX7KIGhRI_8lpmS3ko3Mc7WmBvxeLXifeexXDE0NiX0s8JDSk3OfJrDfSMYrvoRFSKnEOTWuabvQ6nocThcJOrqUI5WcjF3VwY1RkISj4SCdvOvB4mXSfQ2-FaZUo0QxUu0gA5S-FDjY4qoPyzVkywdeVc Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:54:23.904621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}] Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f4b50b2d16134e02b13989bc2579a337 Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. Jun 07 04:54:23.906312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f'} Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:54:23.907147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. Jun 07 04:54:23.908416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:23.909931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Returning 404 to user: Instance 7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:54:23.909931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e65c3861-9154-45c2-a6cf-c8c659a51ddd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f" status: 404 len: 111 microversion: 2.1 time: 0.031143 Jun 07 04:54:23.909931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 300/601] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:23 2022] GET /compute/v2.1/servers/7a5cf51f-6ef7-4fa9-aafc-a99a40f4592f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:54:23.915452 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3c8c9b9e-5293-464b-a759-af88b8776923 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '.version_select at 0x7f3d5dc20700>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:23.934232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3c8c9b9e-5293-464b-a759-af88b8776923 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-537309053" status: 202 len: 0 microversion: 2.1 time: 0.023371 Jun 07 04:54:23.934809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 302/602] 10.222.0.40 () {58 vars in 1217 bytes} [Tue Jun 7 04:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-537309053 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:54:24.338960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:24.339841 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:24.345902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:24.346551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:24.347479 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:24.348087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:24.455514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:24.465893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e64e12ad-ffa2-40fc-872f-800e9ecef5c0 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 200 len: 1603 microversion: 2.1 time: 0.130618 Jun 07 04:54:24.466889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 301/603] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:24 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 1603 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:54:24.515599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-aac3a0f7-3534-4921-9beb-5a626a36833f req-c8a21958-aebf-4751-aa42-b145c5fba884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fa9ff3-99a4-41d3-8492-a3a240d6d73e", "name": "network-vif-deleted", "tag": "db28e18b-ffdc-4a2e-84c0-e448e43554aa"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:24.526969 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-aac3a0f7-3534-4921-9beb-5a626a36833f req-c8a21958-aebf-4751-aa42-b145c5fba884 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:24.527496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-aac3a0f7-3534-4921-9beb-5a626a36833f req-c8a21958-aebf-4751-aa42-b145c5fba884 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:24.539445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-aac3a0f7-3534-4921-9beb-5a626a36833f req-c8a21958-aebf-4751-aa42-b145c5fba884 service nova] Creating event network-vif-deleted:db28e18b-ffdc-4a2e-84c0-e448e43554aa for instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e on hv-cinder-83699 Jun 07 04:54:24.545164 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-aac3a0f7-3534-4921-9beb-5a626a36833f req-c8a21958-aebf-4751-aa42-b145c5fba884 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 Jun 07 04:54:24.546565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 303/604] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:54:25.483460 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:25.484122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:25.491383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:25.492104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:25.492955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:25.493506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:25.508611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e HTTP/1.1 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:54:25.510359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:54:25.512050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '30fa9ff3-99a4-41d3-8492-a3a240d6d73e'} Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:54:25.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:54:25.514759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:25.516506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:54:25.516506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1e1e7343-2573-425e-b917-9b71187eedf7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 404 len: 111 microversion: 2.1 time: 0.032276 Jun 07 04:54:25.516506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 302/605] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:25 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:54:25.523443 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-05a5a488-5c70-454a-bbfd-4dee755fb811 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '.version_select at 0x7f3d5dc7be50>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:25.542509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-05a5a488-5c70-454a-bbfd-4dee755fb811 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936679410" status: 202 len: 0 microversion: 2.1 time: 0.024501 Jun 07 04:54:25.543116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 304/606] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Jun 7 04:54:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936679410 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 04:54:26.215603 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e7ee5707-34c6-4963-9d48-b42a5808b559 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: .version_select at 0x7f3d5dc2c040>, body: {"keypair": {"name": "tempest-keypair-1144093035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDS/DVGcL2Nz+d6xa9cmAP2nSJ1ujQW5N461QGoqVQj/jpaawqWOAmkOyf5i30OQFZZfF9Il2z419CDq/OQ/Y4H3tBmosz+YKLk2O6QNLMvvgLG6cWpP6AgZJHs97QSE1g=="}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:26.231287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-e7ee5707-34c6-4963-9d48-b42a5808b559 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:54:26.235504 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-e7ee5707-34c6-4963-9d48-b42a5808b559 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for user 68a87c36e92b4dccbff62094846335f0 and project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:54:26.261571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e7ee5707-34c6-4963-9d48-b42a5808b559 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049772 Jun 07 04:54:26.262167 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 303/607] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:54:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:26.956642 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:26.957268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:26.968070 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:26.968764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:26.969574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:26.970164 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:26.995893 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:54:27.074038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4d4ea6dc-69f1-48e7-ba54-6f35f2ebe43d tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 204 len: 0 microversion: 2.1 time: 0.121432 Jun 07 04:54:27.079417 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 305/608] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:54:26 2022] DELETE /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:54:27.090912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:27.092186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:27.099875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:27.100330 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:27.101117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:27.101586 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:27.305176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:27.312567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9363f71a-d0a0-47f8-b44b-6024a01fa184 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1506 microversion: 2.1 time: 0.231253 Jun 07 04:54:27.313373 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 304/609] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:27 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:27.670526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1408584695", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0dc8a98-51e8-40e9-a052-24460dd80c5e"}], "security_groups": [{"name": "tempest-securitygroup--1407447541"}], "key_name": "tempest-keypair-1144093035", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:27.981775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] validate_networks() for [('b0dc8a98-51e8-40e9-a052-24460dd80c5e', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:54:28.329312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:28.330026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:28.338057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:28.338626 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:28.339482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:28.339990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:28.453268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:54:28.453718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:54:28.454222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:54:28.454917 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:54:28.455312 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:54:28.465760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:28.466844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:28.467651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:28.468083 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:28.491105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:54:28.497350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Getting quotas for user 68a87c36e92b4dccbff62094846335f0 and project 37a2f67512cf46d58b5655cb15ce502d. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:54:28.506397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:28.511576 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:54:28.514357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:54:28.514865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0b80cfd0-241b-45ba-8af1-b241c93eb54f tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 200 len: 1506 microversion: 2.1 time: 0.189499 Jun 07 04:54:28.515439 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 305/610] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:28 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:54:28.566009 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-57c1168c-7752-4894-9cb8-59e6af3b54fc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.900020 Jun 07 04:54:28.566890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 306/611] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:54:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:54:28.576604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7fc2413e-e808-4383-bb2f-a952ac7c3ba7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:28.577231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7fc2413e-e808-4383-bb2f-a952ac7c3ba7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:28.648430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-47271fc1-078d-4a5f-8fff-d4a4a5447caa req-dbd4327f-361f-44fe-897a-03d657eb9f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce359ec-5b2a-4c16-bb00-7b12798ec4d5", "name": "network-vif-deleted", "tag": "db037bae-92bb-4b9a-916d-da9f24caf5a4"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:28.658766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-47271fc1-078d-4a5f-8fff-d4a4a5447caa req-dbd4327f-361f-44fe-897a-03d657eb9f52 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:28.659671 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-47271fc1-078d-4a5f-8fff-d4a4a5447caa req-dbd4327f-361f-44fe-897a-03d657eb9f52 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:28.665311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7fc2413e-e808-4383-bb2f-a952ac7c3ba7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:28.677758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-47271fc1-078d-4a5f-8fff-d4a4a5447caa req-dbd4327f-361f-44fe-897a-03d657eb9f52 service nova] Creating event network-vif-deleted:db037bae-92bb-4b9a-916d-da9f24caf5a4 for instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 on hv-cinder-83699 Jun 07 04:54:28.692971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-47271fc1-078d-4a5f-8fff-d4a4a5447caa req-dbd4327f-361f-44fe-897a-03d657eb9f52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046056 Jun 07 04:54:28.694979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7fc2413e-e808-4383-bb2f-a952ac7c3ba7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1238 microversion: 2.1 time: 0.121969 Jun 07 04:54:28.695471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 306/612] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:28 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:28.696266 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 307/613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:54:29.532533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:29.533136 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:29.539868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.540327 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.541093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.541584 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.556833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] HTTP exception thrown: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Request method failure captured: Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 HTTP/1.1 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthP1FPaEHk91cJ2SUPblGX7KIGhRI_8lpmS3ko3Mc7WmBvxeLXifeexXDE0NiX0s8JDSk3OfJrDfSMYrvoRFSKnEOTWuabvQ6nocThcJOrqUI5WcjF3VwY1RkISj4SCdvOvB4mXSfQ2-FaZUo0QxUu0gA5S-FDjY4qoPyzVkywdeVc Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:54:29.558372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}] Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f4b50b2d16134e02b13989bc2579a337 Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. Jun 07 04:54:29.559948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '1ce359ec-5b2a-4c16-bb00-7b12798ec4d5'} Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:54:29.560896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. Jun 07 04:54:29.562369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:54:29.563795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Returning 404 to user: Instance 1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:54:29.563795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bc3581ee-4b49-48c9-8111-d8b1aea1f4fb tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5" status: 404 len: 111 microversion: 2.1 time: 0.031135 Jun 07 04:54:29.563795 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 307/614] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:29 2022] GET /compute/v2.1/servers/1ce359ec-5b2a-4c16-bb00-7b12798ec4d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:54:29.569554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:29.570143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:29.576311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.576765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.577560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.578002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.602646 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:54:29.648004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:29.684852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9e77f7c6-fa2f-49a0-a0a1-bd1f0910f5a3 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 204 len: 0 microversion: 2.1 time: 0.119997 Jun 07 04:54:29.685551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 308/615] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:54:29 2022] DELETE /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 04:54:29.694447 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:29.695069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:29.701409 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.701863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.702636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.703070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.713114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:29.713840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:29.719716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.720397 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.721162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:29.722561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:29.810382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:29.818504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d90a8101-20d2-468a-8d60-859233576d6a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1290 microversion: 2.1 time: 0.109641 Jun 07 04:54:29.819072 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 309/616] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:29 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:54:29.869147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:29.876806 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7e3c1777-d877-4919-8e57-1126e16f796b tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.187201 Jun 07 04:54:29.877393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 308/617] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:29 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:30.836274 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:30.836813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:30.843270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:30.843719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:30.844480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:30.844922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:30.894397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:30.896440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:30.902976 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:30.903624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:30.904384 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:30.904999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:30.913570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:30.923534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6a5bfb33-b67d-4e2b-a6b1-4a1b6c591ee6 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1296 microversion: 2.1 time: 0.091629 Jun 07 04:54:30.924108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 310/618] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:30 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:31.057170 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:31.064566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-209a5a08-861c-48a1-bef2-ac5fd98c5385 tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1520 microversion: 2.1 time: 0.174039 Jun 07 04:54:31.065132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 309/619] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:30 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:31.842892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-773db851-26cb-461d-9a69-8b0d5275159b req-9260a68b-3f80-4f5c-b9c0-ca2f8912a75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ac6b6c-d38b-4b7d-9200-833ed36cc465", "name": "network-vif-deleted", "tag": "efcb93a9-49dd-438d-add9-d3f7801582eb"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:31.852653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-773db851-26cb-461d-9a69-8b0d5275159b req-9260a68b-3f80-4f5c-b9c0-ca2f8912a75b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:31.853100 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-773db851-26cb-461d-9a69-8b0d5275159b req-9260a68b-3f80-4f5c-b9c0-ca2f8912a75b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:31.865627 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-773db851-26cb-461d-9a69-8b0d5275159b req-9260a68b-3f80-4f5c-b9c0-ca2f8912a75b service nova] Creating event network-vif-deleted:efcb93a9-49dd-438d-add9-d3f7801582eb for instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 on hv-cinder-83699 Jun 07 04:54:31.882396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-773db851-26cb-461d-9a69-8b0d5275159b req-9260a68b-3f80-4f5c-b9c0-ca2f8912a75b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043129 Jun 07 04:54:31.888504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 311/620] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:31.940608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:31.941309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:31.948533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:31.949334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:31.950348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:31.951109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:32.084605 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:32.085342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:32.085906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:32.092021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:32.092470 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:32.093254 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:32.094062 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:32.095466 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fdac66e5-3ebe-4ac3-9f11-45550cf53fbe tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.158711 Jun 07 04:54:32.106165 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 310/621] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:31 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:32.133980 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:32.134428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:32.134879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lazy-loading 'fault' on Instance uuid 16ac6b6c-d38b-4b7d-9200-833ed36cc465 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:54:32.179899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b50b2d16134e02b13989bc2579a337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd1cc2e8e8455b8e6e656f76b603d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:32.192724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b575032e-2d7f-40bb-883a-f45db10ca35e tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 200 len: 1311 microversion: 2.1 time: 0.113612 Jun 07 04:54:32.193267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 312/622] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:32 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:54:33.113384 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:33.113981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:33.120573 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:33.121023 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:33.122063 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:33.122498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:33.210719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:33.211359 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] [instance: 16ac6b6c-d38b-4b7d-9200-833ed36cc465] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:33.218697 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:33.219166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:33.219953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:33.220750 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:33.240010 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] HTTP exception thrown: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Request method failure captured: Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 HTTP/1.1 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthP1FPaEHk91cJ2SUPblGX7KIGhRI_8lpmS3ko3Mc7WmBvxeLXifeexXDE0NiX0s8JDSk3OfJrDfSMYrvoRFSKnEOTWuabvQ6nocThcJOrqUI5WcjF3VwY1RkISj4SCdvOvB4mXSfQ2-FaZUo0QxUu0gA5S-FDjY4qoPyzVkywdeVc Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:54:33.241692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11bd1cc2e8e8455b8e6e656f76b603d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11bd1cc2e8e8455b8e6e656f76b603d8"}]}] Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 11bd1cc2e8e8455b8e6e656f76b603d8 Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947695812 Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f4b50b2d16134e02b13989bc2579a337 Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947695812-project Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. Jun 07 04:54:33.243399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '16ac6b6c-d38b-4b7d-9200-833ed36cc465'} Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:54:33.248022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. Jun 07 04:54:33.249590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:54:33.250890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] Returning 404 to user: Instance 16ac6b6c-d38b-4b7d-9200-833ed36cc465 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:54:33.250890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d4912604-d86f-41a5-931b-f68eeb5c1fbd tempest-ServerRescueNegativeTestJSON-1947695812 tempest-ServerRescueNegativeTestJSON-1947695812-project] 10.222.0.40 "GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465" status: 404 len: 111 microversion: 2.1 time: 0.036938 Jun 07 04:54:33.250890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 313/623] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:33 2022] GET /compute/v2.1/servers/16ac6b6c-d38b-4b7d-9200-833ed36cc465 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 04:54:33.256607 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:33.260261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:33.265453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7a031609-e27b-453b-ae44-06dcb6bae98b tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.155803 Jun 07 04:54:33.266097 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 311/624] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:33 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:33.902866 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-73b35577-2fcb-4fcb-8277-5d791123050b req-ea2d8a0b-14af-404e-91bb-1263b8063ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41c0f77-f2c7-4c2f-a303-7db1682da5d9", "tag": "5ca615db-da1b-4bad-8e7b-412290da8da4"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:33.911524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-73b35577-2fcb-4fcb-8277-5d791123050b req-ea2d8a0b-14af-404e-91bb-1263b8063ea2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:33.911973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-73b35577-2fcb-4fcb-8277-5d791123050b req-ea2d8a0b-14af-404e-91bb-1263b8063ea2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:33.922842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-73b35577-2fcb-4fcb-8277-5d791123050b req-ea2d8a0b-14af-404e-91bb-1263b8063ea2 service nova] Creating event network-changed:5ca615db-da1b-4bad-8e7b-412290da8da4 for instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 on hv-cinder-83699 Jun 07 04:54:33.927827 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-73b35577-2fcb-4fcb-8277-5d791123050b req-ea2d8a0b-14af-404e-91bb-1263b8063ea2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028655 Jun 07 04:54:33.928404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 314/625] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:34.283426 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:34.284046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:34.292321 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:34.292782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:34.293807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:34.294424 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:34.448564 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:34.462453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-37192b12-3149-4e3c-942b-c569992f7fce tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.183463 Jun 07 04:54:34.463044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 312/626] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:34 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:35.480688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:35.482141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:35.489408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:35.490270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:35.491391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:35.492122 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:35.732325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:35.740048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-df4a5a24-3cda-4cba-81cf-cf623fd9ed24 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.264431 Jun 07 04:54:35.740624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 315/627] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:35 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:36.756987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:36.758257 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:36.765724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:36.766348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:36.767354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:36.767952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:36.970760 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:36.979181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5c95cde8-cee2-4acf-abb1-abd9f42726ac tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.226717 Jun 07 04:54:36.979755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 313/628] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:36 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:38.001155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:38.002546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:38.010032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:38.010574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:38.011337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:38.011810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:38.230357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:38.238910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f8081d59-b2c7-43a7-9667-c8615576a07e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.244587 Jun 07 04:54:38.240289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 316/629] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:37 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:39.258341 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:39.259859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:39.264777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:39.268781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:39.269271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:39.270948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:39.271392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:39.427250 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:39.438376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3a9647c0-8263-44a5-ac3e-ab6cb57dfb98 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.186057 Jun 07 04:54:39.439449 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 314/630] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:39 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:39.748191 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-ce4c7a6d-14d9-4dde-9a70-529d1dda260c req-4fae4eab-0442-42d3-853d-49a1453d9289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41c0f77-f2c7-4c2f-a303-7db1682da5d9", "name": "network-vif-plugged", "status": "completed", "tag": "5ca615db-da1b-4bad-8e7b-412290da8da4"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:39.761325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:39.762445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:39.767550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-ce4c7a6d-14d9-4dde-9a70-529d1dda260c req-4fae4eab-0442-42d3-853d-49a1453d9289 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:39.767997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-ce4c7a6d-14d9-4dde-9a70-529d1dda260c req-4fae4eab-0442-42d3-853d-49a1453d9289 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:39.780415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-ce4c7a6d-14d9-4dde-9a70-529d1dda260c req-4fae4eab-0442-42d3-853d-49a1453d9289 service nova] Creating event network-vif-plugged:5ca615db-da1b-4bad-8e7b-412290da8da4 for instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 on hv-cinder-83699 Jun 07 04:54:39.786414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-ce4c7a6d-14d9-4dde-9a70-529d1dda260c req-4fae4eab-0442-42d3-853d-49a1453d9289 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042965 Jun 07 04:54:39.787617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 317/631] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:40.459065 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:40.460346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:40.470660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:40.471917 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:40.473733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:40.474595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:40.798700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:40.806474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-55eb9ea7-7b63-4d66-bbb2-92f572d2f08a tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1364 microversion: 2.1 time: 0.354243 Jun 07 04:54:40.807054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 315/632] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:40 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:41.829069 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:41.830429 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:41.838734 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:41.839183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:41.839966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:41.840409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:42.100306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:42.108236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-db4eb9af-eeaa-45b6-93a9-a1a11876667e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1550 microversion: 2.1 time: 0.288774 Jun 07 04:54:42.108816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 318/633] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:54:41 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1550 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:54:42.125889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:42.126398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:42.139825 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:42.140598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:42.141643 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:42.142266 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:42.283808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cadec675-5eee-4a7d-93a5-acb201999fc3 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161869 Jun 07 04:54:42.284395 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 316/634] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 04:54:42 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:42.742105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bc81070e-e8d8-4b74-8606-c615004f6b1a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: .version_select at 0x7f3d5db358b0>, body: {"keypair": {"name": "tempest-keypair-1770242850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpw4zW0/eNPmCcAop5jX1I4DndexYGK9SdISan2s0G+5kXeZzj3uV/5suN50apGn5twywf83vcAJ232iFRipCKoenCjHzVGZA1M2nzem/KU7RL8bXdqUpfek5c10z9sxA=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:42.757356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-bc81070e-e8d8-4b74-8606-c615004f6b1a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:54:42.762056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-bc81070e-e8d8-4b74-8606-c615004f6b1a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for user 54eb57ad75144537b96ca90eb4e8f778 and project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:54:42.765017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:42.810925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bc81070e-e8d8-4b74-8606-c615004f6b1a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.211523 Jun 07 04:54:42.813429 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 319/635] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Jun 7 04:54:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 04:54:43.400978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-c3e971ff-98ce-4e4e-868c-bb57c9e4135f req-a266d20a-da48-4a0a-bf8b-e85b42ca0fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41c0f77-f2c7-4c2f-a303-7db1682da5d9", "tag": "5ca615db-da1b-4bad-8e7b-412290da8da4"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:43.414586 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-c3e971ff-98ce-4e4e-868c-bb57c9e4135f req-a266d20a-da48-4a0a-bf8b-e85b42ca0fdc service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:43.415431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-c3e971ff-98ce-4e4e-868c-bb57c9e4135f req-a266d20a-da48-4a0a-bf8b-e85b42ca0fdc service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:43.431865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-c3e971ff-98ce-4e4e-868c-bb57c9e4135f req-a266d20a-da48-4a0a-bf8b-e85b42ca0fdc service nova] Creating event network-changed:5ca615db-da1b-4bad-8e7b-412290da8da4 for instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 on hv-cinder-83699 Jun 07 04:54:43.440104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-c3e971ff-98ce-4e4e-868c-bb57c9e4135f req-a266d20a-da48-4a0a-bf8b-e85b42ca0fdc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045284 Jun 07 04:54:43.442960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 317/636] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:44.342936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-829726892", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63d492c6-7126-464a-9b77-1928c333c71e"}], "security_groups": [{"name": "tempest-securitygroup--1145397040"}], "key_name": "tempest-keypair-1770242850", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:44.543007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] validate_networks() for [('63d492c6-7126-464a-9b77-1928c333c71e', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:54:45.053540 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:54:45.054076 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:54:45.054828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:54:45.055330 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:54:45.055966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:54:45.064990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:45.065570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:45.067156 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:45.067935 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:45.088877 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:54:45.094435 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for user 54eb57ad75144537b96ca90eb4e8f778 and project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:54:45.108228 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:54:45.110974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:54:45.172386 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c310a6ff-0726-4aec-8eaf-083d06821385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.834200 Jun 07 04:54:45.174445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 320/637] 10.222.0.40 () {62 vars in 1187 bytes} [Tue Jun 7 04:54:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 04:54:45.200608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:45.201215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:45.208634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:45.292735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:45.302401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:45.303930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:45.305057 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e0ea48a7-4aad-43ba-8513-5b1cba1bb2e4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1281 microversion: 2.20 time: 0.122233 Jun 07 04:54:45.305657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 318/638] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:45 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:46.324115 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:46.324708 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:46.334148 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:46.334879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:46.336033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:46.337061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:46.407844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:46.416921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:46.418470 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:46.419655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c3de9c2b-85b0-4e26-a382-c5c20d58e851 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1351 microversion: 2.20 time: 0.100309 Jun 07 04:54:46.420543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 321/639] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:46 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:54:47.438208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:47.438881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:47.446774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:47.447251 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:47.448025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:47.448459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:47.582560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:47.590870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:47.592367 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:47.593730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-98e45cf0-5628-4876-8d2c-fc550bfcd98c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.159454 Jun 07 04:54:47.594288 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 319/640] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:47 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:47.777698 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-1ae3680d-ea4a-4204-92cb-dabb08249eca req-05e422cc-94af-4457-acfe-0e59393e67ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:47.789591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-1ae3680d-ea4a-4204-92cb-dabb08249eca req-05e422cc-94af-4457-acfe-0e59393e67ea service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:47.790140 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-1ae3680d-ea4a-4204-92cb-dabb08249eca req-05e422cc-94af-4457-acfe-0e59393e67ea service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:47.811988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-1ae3680d-ea4a-4204-92cb-dabb08249eca req-05e422cc-94af-4457-acfe-0e59393e67ea service nova] Creating event network-changed:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:54:47.819725 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-1ae3680d-ea4a-4204-92cb-dabb08249eca req-05e422cc-94af-4457-acfe-0e59393e67ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045866 Jun 07 04:54:47.820541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 322/641] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:54:48.613008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:48.613663 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:48.620129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:48.620572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:48.621599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:48.622030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:48.754754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:48.762578 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:48.764065 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:48.765149 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5e3d7491-0a47-4d13-a906-656349872609 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.156114 Jun 07 04:54:48.765733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 320/642] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:48 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:49.784251 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:49.785808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:49.791745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:49.792180 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:49.792950 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:49.793414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:49.921627 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:49.930216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:49.931703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:49.932794 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3e483a5f-9fc1-4d73-89b5-7d00f82afc4d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.153298 Jun 07 04:54:49.933376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 323/643] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:49 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:50.950472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:50.951087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:50.957729 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:50.958176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:50.958939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:50.959374 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:51.088200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:51.096098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:51.098357 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:51.099473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2cb9cbde-2c0d-40b5-bbce-dba0af91e6cb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.152911 Jun 07 04:54:51.100013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 321/644] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:50 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:52.117982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:52.118585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:52.125416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:52.125862 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:52.126622 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:52.127056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:52.255963 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:52.264955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:52.266481 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:52.267793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-94a80505-208a-4ba7-942e-32e72c751cff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.154510 Jun 07 04:54:52.268344 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 324/645] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:52 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:53.286103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:53.286744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:53.293967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:53.294411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:53.295174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:53.295608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:53.437042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:53.444904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:53.446451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:53.447558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6d57dd40-ccb7-4b08-aa0c-fc66d42018c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.165875 Jun 07 04:54:53.448127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 322/646] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:53 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:53.805623 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-4fea978a-4215-4d8a-abff-e162ce89c91b req-38906dfa-1f78-4c74-b481-1385c5083fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "name": "network-vif-plugged", "status": "completed", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:53.813645 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-4fea978a-4215-4d8a-abff-e162ce89c91b req-38906dfa-1f78-4c74-b481-1385c5083fed service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:53.814095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-4fea978a-4215-4d8a-abff-e162ce89c91b req-38906dfa-1f78-4c74-b481-1385c5083fed service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:53.825204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-4fea978a-4215-4d8a-abff-e162ce89c91b req-38906dfa-1f78-4c74-b481-1385c5083fed service nova] Creating event network-vif-plugged:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:54:53.830020 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-4fea978a-4215-4d8a-abff-e162ce89c91b req-38906dfa-1f78-4c74-b481-1385c5083fed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028419 Jun 07 04:54:53.830684 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 325/647] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:54:54.465091 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:54.465744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:54.472247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:54.472787 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:54.473588 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:54.474027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:54.765967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:54.774884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:54.776389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:54.777535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b54e72df-12d2-4e55-9e14-b30cc9112762 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.316333 Jun 07 04:54:54.778083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 323/648] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:54 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:55.792522 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:55.793316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=10 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:55.797656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:55.798284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:55.805314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:55.805760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:55.806511 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:55.806938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:55.941704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:55.950018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:55.951518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:55.952654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-855756ca-b481-4f98-8a01-5087ea1708a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1407 microversion: 2.20 time: 0.161482 Jun 07 04:54:55.953343 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 326/649] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:55 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:56.970811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:56.971356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:56.973574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:54:56.979143 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:56.979572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:56.980322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:56.980751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:57.110341 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:57.119843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:57.121616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:54:57.122753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4e0f679e-0c63-4d95-a566-6e4869e1b47e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1599 microversion: 2.20 time: 0.155943 Jun 07 04:54:57.123294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 324/650] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:54:56 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:54:57.144509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:54:57.145044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:54:57.151388 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:57.151828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:57.152575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:57.153000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:57.228890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9b1b748f-7bfe-4c35-9f5d-760474d14fec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088218 Jun 07 04:54:57.229509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 327/651] 10.222.0.40 () {60 vars in 1315 bytes} [Tue Jun 7 04:54:57 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:54:58.398238 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-6d4202fb-d57a-45a0-8b7c-4fe05afe4fa8 req-3eea710b-8b07-40e9-b634-9b23b64f9fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:54:58.406840 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-6d4202fb-d57a-45a0-8b7c-4fe05afe4fa8 req-3eea710b-8b07-40e9-b634-9b23b64f9fda service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:54:58.407292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-6d4202fb-d57a-45a0-8b7c-4fe05afe4fa8 req-3eea710b-8b07-40e9-b634-9b23b64f9fda service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:54:58.418521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-6d4202fb-d57a-45a0-8b7c-4fe05afe4fa8 req-3eea710b-8b07-40e9-b634-9b23b64f9fda service nova] Creating event network-changed:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:54:58.423446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-6d4202fb-d57a-45a0-8b7c-4fe05afe4fa8 req-3eea710b-8b07-40e9-b634-9b23b64f9fda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029327 Jun 07 04:54:58.424031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 325/652] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:55:05.058191 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:55:05.059128 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:05.065184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:05.065657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:05.066408 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:05.066835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:05.071621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:05.141548 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1327bf87-a2ff-4ed0-b814-0ca373fa05c9 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action" status: 202 len: 0 microversion: 2.1 time: 0.087479 Jun 07 04:55:05.142310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 328/653] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:55:05 2022] POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:55:05.151282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:05.152106 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:05.158294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:05.158739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:05.159583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:05.160054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:05.163020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=69 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:05.308392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:05.316326 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-206f2466-9ccf-42f6-9110-d9df837d4a5f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1750 microversion: 2.1 time: 0.169737 Jun 07 04:55:05.317183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 326/654] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:05 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:06.337441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:06.338270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:06.344919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:06.345591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:06.346313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:06.346752 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:06.494543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:06.502737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-03130b2f-f7d6-4bed-b9b4-883d4874a074 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.170799 Jun 07 04:55:06.503243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 329/655] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:06 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:07.520052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:07.521490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:07.527901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:07.528349 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:07.529100 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:07.529556 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:07.674423 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:07.683346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bd44fbe9-b782-45f8-9da3-78d343e185f0 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.167172 Jun 07 04:55:07.684410 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 327/656] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:07 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:08.700838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:08.701473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:08.707961 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:08.708401 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:08.709184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:08.709642 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:08.851836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:08.859692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-91e23f1b-9059-4686-9497-9772f49fd772 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.162661 Jun 07 04:55:08.860250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 330/657] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:08 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:09.876615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:09.877154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:09.883766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:09.884219 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:09.884983 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:09.885461 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:10.029238 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:10.037298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9b6d531a-ee6b-4bf4-aabf-acf7e7aa0184 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.164595 Jun 07 04:55:10.037866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 328/658] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:09 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:11.054230 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:11.054937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:11.061742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:11.062191 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:11.062961 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:11.063396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:11.206150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:11.215093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e5a852ed-7908-4f4e-aad9-a1c8df98c6d7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.164766 Jun 07 04:55:11.215662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 331/659] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:11 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:12.233452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:12.234002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:12.241150 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:12.241631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:12.242390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:12.242829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:12.392890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:12.400902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4d8ff8b0-640c-4278-99aa-b653feaed562 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.171380 Jun 07 04:55:12.401500 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 329/660] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:12 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:13.417896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:13.418504 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:13.424891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:13.425367 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:13.426123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:13.426554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:13.583532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:13.591626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cbe70856-0fab-4bf1-a725-61e75a82469f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.177550 Jun 07 04:55:13.592186 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 332/661] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:13 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:14.609759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:14.610399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:14.617463 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:14.617915 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:14.618674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:14.619109 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:14.760282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:14.768354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0fdf0236-05a3-4ea8-ab67-bad3652e76e8 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.162600 Jun 07 04:55:14.768914 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 330/662] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:14 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:15.786242 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:15.787216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:15.789710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:15.794936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:15.795377 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:15.796135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:15.796565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:15.943107 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:15.950981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8b7a67f5-edb8-4695-8132-62b23a68ca64 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1755 microversion: 2.1 time: 0.168548 Jun 07 04:55:15.951543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 333/663] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:15 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:55:16.968095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:16.968630 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:16.970918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=28 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:16.976300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:16.976745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:16.977615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:16.978047 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:17.118538 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:55:17.126637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-37ad2f11-262d-4727-8d7e-463e2e360618 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1758 microversion: 2.1 time: 0.162477 Jun 07 04:55:17.127198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 331/664] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:55:16 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:55:58.809201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:55:58.809822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:55:58.811926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:58.812571 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:55:58.818184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:58.818636 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:58.819393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:55:58.819831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:55:58.844647 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-37788bcd-3aa6-4fc6-858f-e349d69cebd9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/ips" status: 200 len: 145 microversion: 2.1 time: 0.039272 Jun 07 04:55:58.845210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 334/665] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 04:55:58 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:00.163437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4726d62f-2ebd-4e33-96ce-4881f788edd5"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:00.164529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:00.166876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:00.167734 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=35 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:00.173700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:00.174145 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:00.174899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:00.175327 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:00.426633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7042b201-a1da-4f8e-a998-ae4a9cae99a7 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266925 Jun 07 04:56:00.427216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 332/666] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:56:00 2022] POST /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:08.968138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:08.969067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:08.972438 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:08.973059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:08.977582 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:08.978030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:08.978787 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:08.979216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:09.011226 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3c60a8e6-0501-40ee-9c8f-0a18b9458030 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Jun 07 04:56:09.012284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 335/667] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:08 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:09.022430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:09.023604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:09.031259 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:09.031709 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:09.032470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:09.032906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:09.062488 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6b016eff-e72e-4a26-b2c8-8ed92c35bc29 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5" status: 200 len: 194 microversion: 2.1 time: 0.044274 Jun 07 04:56:09.063690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 333/668] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Jun 7 04:56:09 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:14.652554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-477124465", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1404641648", "security_groups": [{"name": "tempest-secgroup-smoke-1820215520"}], "block_device_mapping_v2": [{"uuid": "848d1fb9-eff9-412c-b302-b257d1a2c852", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a9cdced-d65a-4ad0-9d69-4961d1237297"}]}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:14.769640 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] validate_networks() for [('3a9cdced-d65a-4ad0-9d69-4961d1237297', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:56:15.133477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:56:15.133898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:56:15.134366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:56:15.134792 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:56:15.135248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:56:15.144695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:15.145136 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:15.145971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:15.146403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:15.162731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:56:15.166568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Getting quotas for user c4a16db9150f433e9b40545a7e68f2c5 and project 5e03f0a90584400b80b912510f02a228. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:56:15.223815 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:56:15.225903 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='848d1fb9-eff9-412c-b302-b257d1a2c852',volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:56:15.352536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-225665fd-9d8d-46c9-b02e-a4b9b0e41517 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703904 Jun 07 04:56:15.357602 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 336/669] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:56:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:56:15.363815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e9e1cc53-4977-411c-bf5d-79c1a6e4b38e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:15.364527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e9e1cc53-4977-411c-bf5d-79c1a6e4b38e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:15.429143 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e9e1cc53-4977-411c-bf5d-79c1a6e4b38e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:15.436346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e9e1cc53-4977-411c-bf5d-79c1a6e4b38e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1094 microversion: 2.1 time: 0.076178 Jun 07 04:56:15.437188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 334/670] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:15 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:15.682820 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc213b5e-2cc7-4db3-bde4-9e41c7527e2f"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:15.684881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:15.691865 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:15.692352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:15.693190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:15.693680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:15.984830 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1b49df0e-a814-4ae7-a38e-47e313f88a2d tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "POST /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306239 Jun 07 04:56:15.985480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 337/671] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 04:56:15 2022] POST /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:16.454143 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:16.454759 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:16.461682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:16.462132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:16.462881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:16.463310 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:16.524521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:16.533090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a32bec68-b912-49af-b39d-3ed276d908d6 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1192 microversion: 2.1 time: 0.083643 Jun 07 04:56:16.533881 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 335/672] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:16 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:17.551846 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:17.552550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:17.558857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:17.559304 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:17.560066 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:17.560501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:17.698455 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:17.706371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8fd790f2-5ce2-48b6-b4fe-bab9a84e6938 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.159170 Jun 07 04:56:17.706942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 338/673] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:17 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:18.097347 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-7620a65c-f6f4-4712-b8c0-1d1d2bda0f40 req-7abd747a-a8a7-48b8-8f08-30ed1f40b111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:18.106441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-7620a65c-f6f4-4712-b8c0-1d1d2bda0f40 req-7abd747a-a8a7-48b8-8f08-30ed1f40b111 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:18.106957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-7620a65c-f6f4-4712-b8c0-1d1d2bda0f40 req-7abd747a-a8a7-48b8-8f08-30ed1f40b111 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:18.119844 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-7620a65c-f6f4-4712-b8c0-1d1d2bda0f40 req-7abd747a-a8a7-48b8-8f08-30ed1f40b111 service nova] Creating event network-changed:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:56:18.126229 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-7620a65c-f6f4-4712-b8c0-1d1d2bda0f40 req-7abd747a-a8a7-48b8-8f08-30ed1f40b111 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032728 Jun 07 04:56:18.126826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 336/674] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:18.724293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:18.724918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:18.731680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:18.732134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:18.732978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:18.733438 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:18.876853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:18.884599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f147e814-086d-4d07-ad5f-a0a4ebf793b5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.164101 Jun 07 04:56:18.894082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 339/675] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:18 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:19.902450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:19.903216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:19.909497 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:19.909957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:19.910719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:19.911160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:20.039634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:20.047277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5ada88e4-d8ef-483a-a88c-acab3c618f40 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.149464 Jun 07 04:56:20.047834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 337/676] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:19 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:21.063812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:21.064428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:21.070907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:21.071352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:21.072111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:21.072547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:21.205578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:21.212938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-187732db-433d-4afe-89e3-d21e86b46faf tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.152994 Jun 07 04:56:21.213765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 340/677] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:21 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:22.230167 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:22.230779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:22.237918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:22.238365 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:22.239115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:22.239547 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:22.374539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:22.382061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c0810d40-10d0-48dc-bb51-43e18e832579 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.155759 Jun 07 04:56:22.382609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 338/678] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:22 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:23.337252 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1703768554"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:23.337837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:23.345861 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.346306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.347059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.347484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.402526 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:23.404200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:23.412498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.413354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.414572 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.415215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.532222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.network.security_group_api [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Removing security group f6a06d19-c2e7-4a93-8ba0-dd4200bb417e from port faf6ae1f-31de-4216-9e3d-668d20acd9b8 Jun 07 04:56:23.658752 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:23.666464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-97f3e285-dc27-4c46-bd4d-739baf6e4b8c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1278 microversion: 2.1 time: 0.270966 Jun 07 04:56:23.667030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 339/679] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:23 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:23.674361 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:23.674361 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:23.680168 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.680619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.681425 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.681865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.711174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-148250f3-7964-4f60-9de1-efbd6c92f62c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043117 Jun 07 04:56:23.711721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 340/680] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:23 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:23.865412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:23.865833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:23.871818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.872273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.873324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.873766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.902518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f09ee39-7be7-4d45-8553-e0eb1b6a1652 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5" status: 200 len: 194 microversion: 2.1 time: 0.041167 Jun 07 04:56:23.903102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 341/681] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Jun 7 04:56:23 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:56:23.913389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:23.913884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:23.919703 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.920164 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.920933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:23.921488 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:23.967766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-01a47480-0be7-4fce-a563-43f14a9082b7 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action" status: 202 len: 0 microversion: 2.1 time: 0.634791 Jun 07 04:56:23.969791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 341/682] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 04:56:23 2022] POST /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:56:23.987855 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-a012d773-602f-45d4-81d5-241e428eac6d req-07365b78-0249-4c7f-81e8-2dfcc74ab28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:24.005264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a012d773-602f-45d4-81d5-241e428eac6d req-07365b78-0249-4c7f-81e8-2dfcc74ab28d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:24.005833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-a012d773-602f-45d4-81d5-241e428eac6d req-07365b78-0249-4c7f-81e8-2dfcc74ab28d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:24.040291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-a012d773-602f-45d4-81d5-241e428eac6d req-07365b78-0249-4c7f-81e8-2dfcc74ab28d service nova] Creating event network-changed:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:56:24.050487 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-a012d773-602f-45d4-81d5-241e428eac6d req-07365b78-0249-4c7f-81e8-2dfcc74ab28d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065616 Jun 07 04:56:24.051795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 342/683] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:24.062046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lazy-loading 'services' on Instance uuid a41c0f77-f2c7-4c2f-a303-7db1682da5d9 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:56:24.172464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-de5e5ef4-09a1-414d-8413-5fe57b5fa590 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5" status: 202 len: 0 microversion: 2.1 time: 0.255873 Jun 07 04:56:24.183949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 342/684] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:56:23 2022] DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/4726d62f-2ebd-4e33-96ce-4881f788edd5 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 04:56:24.685048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:24.685803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:24.692170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:24.692621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:24.693431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:24.693981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:24.889786 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:24.898393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-905d92a6-6883-410d-b2c0-08466d87336e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.218325 Jun 07 04:56:24.898966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 343/685] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:24 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:24.993514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:24.994125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:25.001369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.001819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.002589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.003021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.026713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0e188c24-6a77-4686-9567-2ec7d4b38b45 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/ips" status: 200 len: 150 microversion: 2.20 time: 0.037841 Jun 07 04:56:25.027287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 343/686] 10.222.0.40 () {60 vars in 1288 bytes} [Tue Jun 7 04:56:24 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:56:25.358129 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:25.358734 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:25.361521 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:25.362184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:25.369326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.369782 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.370567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.371021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.454453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lazy-loading 'services' on Instance uuid 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:56:25.540979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-12b67d34-b0fe-408d-9eed-9810ec219e81 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments/ceb14534-e445-4f8c-ac7a-89a181ca84c5" status: 202 len: 0 microversion: 2.1 time: 0.186725 Jun 07 04:56:25.541772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 344/687] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:56:25 2022] DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments/ceb14534-e445-4f8c-ac7a-89a181ca84c5 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:56:25.550766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:25.551748 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:25.553770 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:25.559236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.559685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.560438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.560869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.589448 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b6abb24a-0006-43cf-a635-2a735bb72abc tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Jun 07 04:56:25.590245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 344/688] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:25 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:25.916406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:25.917276 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:25.924258 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.924711 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:25.925515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:25.925948 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:26.066810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-332aa359-47bc-4dbc-b1af-8c8cb4ceeeab req-99add522-b9de-4fac-9858-fa2257107d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:26.077472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-332aa359-47bc-4dbc-b1af-8c8cb4ceeeab req-99add522-b9de-4fac-9858-fa2257107d75 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:26.078896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-332aa359-47bc-4dbc-b1af-8c8cb4ceeeab req-99add522-b9de-4fac-9858-fa2257107d75 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:26.084366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:26.094320 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-182000e9-e50e-404f-a748-fe1fa68c6b23 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.181897 Jun 07 04:56:26.094989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 345/689] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:25 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:26.102189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-332aa359-47bc-4dbc-b1af-8c8cb4ceeeab req-99add522-b9de-4fac-9858-fa2257107d75 service nova] Creating event network-changed:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:56:26.107009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-332aa359-47bc-4dbc-b1af-8c8cb4ceeeab req-99add522-b9de-4fac-9858-fa2257107d75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045387 Jun 07 04:56:26.107921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 345/690] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:56:26.600793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:26.601835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:26.607783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:26.608239 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:26.609006 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:26.610291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:26.638179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1f0f6590-b516-4999-814b-1d75a39f77d4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 Jun 07 04:56:26.638719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 346/691] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:26 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:27.112043 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:27.112739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.118898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.119345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.120133 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.120566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.216391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:27.217027 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.224400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.224852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.225653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.226085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.249443 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lazy-loading 'flavor' on Instance uuid bbb81ec9-aca6-4774-86dc-2156f21c6a6e {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:56:27.260798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:27.269015 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-67363754-5882-4e7c-9212-f02c742a4d00 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.161664 Jun 07 04:56:27.269618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 346/692] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:27 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:27.490393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:27.490904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.497274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.497731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.498770 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.499201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.538927 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cc2afff4-6cfc-4a7d-af4f-603347b8b24f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/fc213b5e-2cc7-4db3-bde4-9e41c7527e2f" status: 200 len: 194 microversion: 2.1 time: 0.052808 Jun 07 04:56:27.540533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 347/693] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Jun 7 04:56:27 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/fc213b5e-2cc7-4db3-bde4-9e41c7527e2f => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:56:27.553901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:27.554677 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.563180 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.564062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.565073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.565902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.664662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lazy-loading 'services' on Instance uuid a41c0f77-f2c7-4c2f-a303-7db1682da5d9 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:56:27.668531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:27.698824 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dcc4c982-0c04-43cf-90f5-16e91ca6a1ea tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/action" status: 202 len: 0 microversion: 2.20 time: 0.486054 Jun 07 04:56:27.702491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 347/694] 10.222.0.40 () {62 vars in 1318 bytes} [Tue Jun 7 04:56:27 2022] POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 04:56:27.705491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:27.706502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.714930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.715450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.716483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.717179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.754064 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6c726958-5f49-4f39-b0c1-f2b0685a7317 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053299 Jun 07 04:56:27.754861 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 348/695] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:27 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:27.761428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:27.762790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:27.763705 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c1bc5659-5449-4fce-8376-a53a00ec2b25 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/fc213b5e-2cc7-4db3-bde4-9e41c7527e2f" status: 202 len: 0 microversion: 2.1 time: 0.215626 Jun 07 04:56:27.764298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 348/696] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:56:27 2022] DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments/fc213b5e-2cc7-4db3-bde4-9e41c7527e2f => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:56:27.769798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.770234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.771007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:27.771433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:27.775615 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:27.928389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:27.936923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:27.939126 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:27.940556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fa6c64e8-6e3d-451f-9c98-7f85f06a9ce1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.184773 Jun 07 04:56:27.941107 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 349/697] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:27 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:28.287937 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:28.288635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:28.294832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.295283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.296043 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.296812 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.430930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:28.439026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fbc985f5-0b00-4137-8e37-fc3dbe893784 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.155777 Jun 07 04:56:28.439575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 349/698] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:28 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:28.765331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:28.766949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:28.773458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.773903 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.774690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.775115 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.805958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-269744ab-b3b7-4879-88ba-0acbbf937ece tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044659 Jun 07 04:56:28.806506 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 350/699] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:28 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:56:28.816373 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:28.816880 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:28.823085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.823542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.824340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.824761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.905657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] HTTP exception thrown: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae is not attached to volume ceb14534-e445-4f8c-ac7a-89a181ca84c5 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Request method failure captured: Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments/ceb14534-e445-4f8c-ac7a-89a181ca84c5 HTTP/1.1 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintmupWHbsGFow4-KNGHYSnAwUAVDvsnzujZbJtVQt4_4D9grdghQt4uogApw4cQFmVD59Z--NXLVao0Bu2lmBx7oRWxfNvKVsDp_0uHXZHf0yZQFauEW-1ETAhYNfGzm-IrawOpnTSLrFousFmpvV16FIG6cs4_RDfucGVrChPcZXSs Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 577dff55add94455a42bb2dd447bb889 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:56:28.905777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/577dff55add94455a42bb2dd447bb889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/577dff55add94455a42bb2dd447bb889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_577dff55add94455a42bb2dd447bb889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/577dff55add94455a42bb2dd447bb889"}]}] Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 577dff55add94455a42bb2dd447bb889 Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestMinimumBasicScenario-931706571-project Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: b09498db46e54118ba65ed54c7cff650 Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestMinimumBasicScenario-931706571-project Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:56:28.908484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae is not attached to volume ceb14534-e445-4f8c-ac7a-89a181ca84c5 Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'server_id': '8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae', 'id': 'ceb14534-e445-4f8c-ac7a-89a181ca84c5'} Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ceb14534-e445-4f8c-ac7a-89a181ca84c5. Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:28.909403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae is not attached to volume ceb14534-e445-4f8c-ac7a-89a181ca84c5 Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae is not attached to volume ceb14534-e445-4f8c-ac7a-89a181ca84c5 Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:28.910977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Returning 404 to user: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae is not attached to volume ceb14534-e445-4f8c-ac7a-89a181ca84c5 {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:28.912350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-61bdb305-8903-426b-865b-b75d299f73f1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments/ceb14534-e445-4f8c-ac7a-89a181ca84c5" status: 404 len: 154 microversion: 2.1 time: 0.095516 Jun 07 04:56:28.912350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 350/700] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 04:56:28 2022] DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae/os-volume_attachments/ceb14534-e445-4f8c-ac7a-89a181ca84c5 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:28.960293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:28.961116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:28.963127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:28.964139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:28.969925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.970822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.971713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.972238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.974514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.974925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:28.975690 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:28.976117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.010545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1db82cbd-c165-46b4-8372-054e3b62be1f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052023 Jun 07 04:56:29.011102 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 351/701] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:28 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 04:56:29.116926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:29.117615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:29.118532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:29.124704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.125333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.125628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:29.126095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.126529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.127339 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:29.128576 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7b5bf496-6867-4880-9942-b0b52764d83c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.173348 Jun 07 04:56:29.129216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 351/702] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:28 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:29.154305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a8648a52-7c26-49cd-832e-f0b167d8394e tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040546 Jun 07 04:56:29.154842 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 352/703] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 04:56:29 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 04:56:29.214824 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:29.215311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:29.222466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.222911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.223664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.224097 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.250216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:56:29.326334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b743499b-5f4d-4169-968c-5d67500b85ec tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 204 len: 0 microversion: 2.1 time: 0.115075 Jun 07 04:56:29.327017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 352/704] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:56:29 2022] DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:56:29.335797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:29.336629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:29.344261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.344261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.345579 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.346114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.457644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:29.458491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:29.464567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.465214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.466177 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:29.466665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:29.486669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:29.496934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cbddb69a-b377-4180-a6ad-ef9fd8554e88 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1674 microversion: 2.1 time: 0.164904 Jun 07 04:56:29.497542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 353/705] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:29 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:29.613778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:29.621244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2212f5c0-6524-40e9-becf-b23c3f4a502c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.169152 Jun 07 04:56:29.621819 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 353/706] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:29 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:30.055305 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:30.055811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:30.062016 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.063130 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.063892 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.064329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.087779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:56:30.146374 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:30.146979 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:30.153658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.154105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.154880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.155305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.162332 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2c7f4a1d-a415-4bb2-adb8-43a3ecd6e66f tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 204 len: 0 microversion: 2.1 time: 0.110542 Jun 07 04:56:30.162949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 354/707] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:56:30 2022] DELETE /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:56:30.171382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:30.172926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:30.174882 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:30.180092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.180550 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.181383 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.181827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.342637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.351606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.353094 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.354277 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ea43dff1-8903-4f18-b05e-00cf27b0488d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.211749 Jun 07 04:56:30.354854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 354/708] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:30 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:56:30.364740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.372375 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e767aae3-faa0-49e6-b720-e7aa22fe7ddf tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1553 microversion: 2.1 time: 0.205002 Jun 07 04:56:30.372932 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 355/709] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:30 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:30.514780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:30.515450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:30.522468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.522920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.523683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.524118 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.639380 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:30.640094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:30.646811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.647337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.648173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:30.648673 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:30.652329 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.661349 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ed5d41ba-a5d0-4dfe-ad2a-51891dc3e395 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1674 microversion: 2.1 time: 0.150481 Jun 07 04:56:30.661925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 355/710] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:30 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:30.783188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:30.792044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2a1262b9-6cae-445b-ba8c-faa5b4ebd8de tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.156507 Jun 07 04:56:30.792615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 356/711] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:30 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:31.373513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:31.374131 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:31.381703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.382154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.382922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.383363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.389617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:31.390233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:31.396738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.397188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.397980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.398417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.574710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.582918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.584406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.585590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-95e0f037-1a11-4a15-af53-64ef13f5b147 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.216256 Jun 07 04:56:31.586348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 356/712] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:31 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:31.595658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.603368 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-aebd36ce-8991-412e-ab0e-aa5a86e23d39 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1553 microversion: 2.1 time: 0.217530 Jun 07 04:56:31.603926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 357/713] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:31 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:31.678714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:31.679278 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:31.685322 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.685779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.686546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.686982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.809402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:31.810092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:31.814955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.816954 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.817437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.818202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:31.818631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:31.822634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-11a7d980-62d0-42f9-93c2-9d4b9324fe8f tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1674 microversion: 2.1 time: 0.147847 Jun 07 04:56:31.823276 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 357/714] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:31 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:31.949735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:31.957699 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-71276e94-4dcd-4dfe-b0ca-a8d53e25a15c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.152377 Jun 07 04:56:31.958266 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 358/715] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:31 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:32.604304 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:32.604861 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:32.611353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.611802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.612565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.613001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.621105 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:32.621788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:32.629153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.629659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.630442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.630883 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.816533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:32.819450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:32.825120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:32.826665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:32.826896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-56c26609-44b1-4b3e-8b1f-c197be702fd4 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1553 microversion: 2.1 time: 0.209819 Jun 07 04:56:32.827464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 359/716] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:32 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:32.827901 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c71d7c22-2854-4974-88a1-a59aae78992d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.227965 Jun 07 04:56:32.829068 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 358/717] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:32 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:32.839641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:32.840284 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:32.846350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.846802 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.847561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.847998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.974079 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:32.974690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:32.980590 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.981032 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.981825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:32.982256 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:32.984955 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:32.992678 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0c295f88-36cf-49df-a7c6-6f123406b420 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1674 microversion: 2.1 time: 0.156703 Jun 07 04:56:32.993469 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 360/718] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:32 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:33.112524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:33.119888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5c95b58e-19bc-4c97-8ae4-e1869208d4ae tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.149686 Jun 07 04:56:33.120449 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 359/719] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:32 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:33.845307 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:33.845939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:33.855838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:33.856390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:33.861489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:33.861952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:33.862736 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:33.863180 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:33.863797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:33.864255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:33.865196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:33.865673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.064797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.067286 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.072818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5f5d8c52-37ee-496c-97d3-a7e7d873fdb1 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1553 microversion: 2.1 time: 0.232442 Jun 07 04:56:34.074253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 361/720] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:33 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:34.079957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:34.080585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:34.088535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.090010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:34.090467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.091244 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:34.091682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.091823 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.093391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2e50f4d5-05ec-4ad7-8a94-559e7e296e1e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.241267 Jun 07 04:56:34.094294 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 360/721] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:33 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:34.136325 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:34.136937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:34.143810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:34.144263 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.145042 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:34.145513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.161949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a87c36e92b4dccbff62094846335f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a2f67512cf46d58b5655cb15ce502d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.170311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ab0f06ea-c305-41b9-a927-82b2de011e60 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 200 len: 1606 microversion: 2.1 time: 0.095584 Jun 07 04:56:34.171306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 362/722] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:34 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:34.282950 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:34.290428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2f2ad7c9-20fc-44eb-b778-dfa0b596d29d tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.157808 Jun 07 04:56:34.291203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 361/723] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:34 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:34.350139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-3e6bd350-e9a4-49f2-b750-81c0c8d91250 req-bfbfe1ae-dda4-42cf-b985-e00bb6024787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41c0f77-f2c7-4c2f-a303-7db1682da5d9", "name": "network-vif-deleted", "tag": "5ca615db-da1b-4bad-8e7b-412290da8da4"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:34.358406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-3e6bd350-e9a4-49f2-b750-81c0c8d91250 req-bfbfe1ae-dda4-42cf-b985-e00bb6024787 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:34.358772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-3e6bd350-e9a4-49f2-b750-81c0c8d91250 req-bfbfe1ae-dda4-42cf-b985-e00bb6024787 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:34.370570 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-3e6bd350-e9a4-49f2-b750-81c0c8d91250 req-bfbfe1ae-dda4-42cf-b985-e00bb6024787 service nova] Creating event network-vif-deleted:5ca615db-da1b-4bad-8e7b-412290da8da4 for instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 on hv-cinder-83699 Jun 07 04:56:34.376077 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-3e6bd350-e9a4-49f2-b750-81c0c8d91250 req-bfbfe1ae-dda4-42cf-b985-e00bb6024787 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029540 Jun 07 04:56:34.376841 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 363/724] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:35.092809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:35.093499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:35.104798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.106735 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.107573 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.108207 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.123471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:35.124446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:35.131495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.132355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.133207 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.133742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.138778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:35.143152 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.143600 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.144054 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lazy-loading 'fault' on Instance uuid 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:56:35.190242 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09498db46e54118ba65ed54c7cff650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577dff55add94455a42bb2dd447bb889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:35.198710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b5ab5621-c2c6-44c1-82b2-ee15e13f0b9c tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 200 len: 1347 microversion: 2.1 time: 0.110789 Jun 07 04:56:35.199616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 362/725] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:35 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:35.205426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:35.206316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:35.212542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.213017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.213804 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.214236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.230033 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 HTTP/1.1 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:56:35.231731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:35.233444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'a41c0f77-f2c7-4c2f-a303-7db1682da5d9'} Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:35.237954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:35.239694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:35.241046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:35.241046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2393e6e5-60f7-4346-835d-f2cafaeef258 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 404 len: 111 microversion: 2.1 time: 0.032382 Jun 07 04:56:35.241046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 363/726] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:35 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:35.246392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-359b56e7-470a-496f-9815-15acbdc5aaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '.version_select at 0x7f3d5dcdce50>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:35.268038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-359b56e7-470a-496f-9815-15acbdc5aaee tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144093035" status: 202 len: 0 microversion: 2.1 time: 0.024866 Jun 07 04:56:35.268505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 364/727] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Jun 7 04:56:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144093035 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:56:35.298498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:35.307577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:35.308194 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:35.319719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.320535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.320978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:35.323345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:35.323971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:35.324703 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:35.328949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-32eb8509-7bf6-4ff6-b05d-2715c0b0d3fa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.220741 Jun 07 04:56:35.329776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 364/728] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:35 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:35.363342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:35.516758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:35.525880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c4e209fa-b39c-49cb-8e49-73063ed3b4ba tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.222106 Jun 07 04:56:35.540462 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 365/729] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:35 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:36.218483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:36.218483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] [instance: 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:36.226132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.226774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.227850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.228282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.243126 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] HTTP exception thrown: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Request method failure captured: Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae HTTP/1.1 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintmupWHbsGFow4-KNGHYSnAwUAVDvsnzujZbJtVQt4_4D9grdghQt4uogApw4cQFmVD59Z--NXLVao0Bu2lmBx7oRWxfNvKVsDp_0uHXZHf0yZQFauEW-1ETAhYNfGzm-IrawOpnTSLrFousFmpvV16FIG6cs4_RDfucGVrChPcZXSs Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 577dff55add94455a42bb2dd447bb889 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:56:36.244834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/577dff55add94455a42bb2dd447bb889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/577dff55add94455a42bb2dd447bb889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_577dff55add94455a42bb2dd447bb889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/577dff55add94455a42bb2dd447bb889"}]}] Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 577dff55add94455a42bb2dd447bb889 Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestMinimumBasicScenario-931706571 Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestMinimumBasicScenario-931706571-project Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: b09498db46e54118ba65ed54c7cff650 Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestMinimumBasicScenario-931706571-project Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. Jun 07 04:56:36.246260 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae'} Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:36.247042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. Jun 07 04:56:36.248506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:36.251620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Returning 404 to user: Instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:36.251620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1ed74c32-fe42-495e-b73b-30d610158681 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae" status: 404 len: 111 microversion: 2.1 time: 0.034088 Jun 07 04:56:36.251620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 365/730] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:36 2022] GET /compute/v2.1/servers/8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:36.256078 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-42dc8f70-b78f-4fe1-970c-0fbfaf203c69 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] Calling method '.version_select at 0x7f3d5dcdcd30>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:36.274996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-42dc8f70-b78f-4fe1-970c-0fbfaf203c69 tempest-TestMinimumBasicScenario-931706571 tempest-TestMinimumBasicScenario-931706571-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-275257582" status: 202 len: 0 microversion: 2.1 time: 0.022611 Jun 07 04:56:36.275832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 366/731] 10.222.0.40 () {58 vars in 1268 bytes} [Tue Jun 7 04:56:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-275257582 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:56:36.348046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:36.348732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:36.359221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.359884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.360889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.361445 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.391465 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-2adccbb4-f251-4b07-a05e-7a7d34bf50b2 req-0a2ac774-fd58-4660-9890-a88cafd89c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae", "name": "network-vif-deleted", "tag": "faf6ae1f-31de-4216-9e3d-668d20acd9b8"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:36.406656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-2adccbb4-f251-4b07-a05e-7a7d34bf50b2 req-0a2ac774-fd58-4660-9890-a88cafd89c9e service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.407214 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-2adccbb4-f251-4b07-a05e-7a7d34bf50b2 req-0a2ac774-fd58-4660-9890-a88cafd89c9e service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.421754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-2adccbb4-f251-4b07-a05e-7a7d34bf50b2 req-0a2ac774-fd58-4660-9890-a88cafd89c9e service nova] Creating event network-vif-deleted:faf6ae1f-31de-4216-9e3d-668d20acd9b8 for instance 8ffc34bd-f9ab-4cdc-a5f3-5f2068bf35ae on hv-cinder-83699 Jun 07 04:56:36.429357 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-2adccbb4-f251-4b07-a05e-7a7d34bf50b2 req-0a2ac774-fd58-4660-9890-a88cafd89c9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042247 Jun 07 04:56:36.430602 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 367/732] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:56:36.508417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:36.520535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:36.522674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:36.524030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6d3b99f6-318d-407c-a3dd-0bade8f58de4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.180170 Jun 07 04:56:36.524745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 366/733] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:36 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:56:36.549185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:36.550217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:36.556725 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.557176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.557983 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:36.558427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:36.713046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:36.721182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b7cc968d-191d-47ae-a920-73ae40619f97 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.176476 Jun 07 04:56:36.721858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 368/734] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:36 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:37.542066 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:37.543605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:37.549984 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:37.550791 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:37.552292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:37.552778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:37.585114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 04:56:37.585531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 04:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e (ip 10.222.0.40) !!! Jun 07 04:56:37.738990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:37.739606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:37.746091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:37.746531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:37.747292 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:37.747726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:37.775114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:37.784328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:37.785903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:37.787095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7aee8c09-1eef-45ce-ae4b-67cc23aa963e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.249112 Jun 07 04:56:37.787621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 367/735] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:37 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:37.951253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:37.958868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-96edf4fb-82b5-4bf3-b983-c56d8ea75c17 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.224627 Jun 07 04:56:37.959432 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 369/736] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:37 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:38.346183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-47384310-aa6f-4bf1-83a9-9183774617bd req-790e1493-4814-42be-bcf1-bc963f8e586d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "name": "network-vif-plugged", "status": "completed", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:38.357300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-47384310-aa6f-4bf1-83a9-9183774617bd req-790e1493-4814-42be-bcf1-bc963f8e586d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.358298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-47384310-aa6f-4bf1-83a9-9183774617bd req-790e1493-4814-42be-bcf1-bc963f8e586d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.378841 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-47384310-aa6f-4bf1-83a9-9183774617bd req-790e1493-4814-42be-bcf1-bc963f8e586d service nova] Creating event network-vif-plugged:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:56:38.384095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-47384310-aa6f-4bf1-83a9-9183774617bd req-790e1493-4814-42be-bcf1-bc963f8e586d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043048 Jun 07 04:56:38.384693 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 368/737] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:38.527606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:38.528137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:38.532394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:56:38.537213 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.537765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.538541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.538977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.559886 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 HTTP/1.1 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:56:38.562208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.567232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'a41c0f77-f2c7-4c2f-a303-7db1682da5d9'} Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:38.568209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.569705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.571206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:38.571206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-db505b8e-5392-4347-b711-3d6db572ee3c tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 404 len: 111 microversion: 2.1 time: 0.040106 Jun 07 04:56:38.571206 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 370/738] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:56:38 2022] DELETE /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:38.573094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:38.573832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: a41c0f77-f2c7-4c2f-a303-7db1682da5d9] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:38.580285 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.580734 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.581533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.581972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.602289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 HTTP/1.1 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:56:38.603987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.605685 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'a41c0f77-f2c7-4c2f-a303-7db1682da5d9'} Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:38.606427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. Jun 07 04:56:38.607730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:38.608810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance a41c0f77-f2c7-4c2f-a303-7db1682da5d9 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:38.608810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f77abf2-4af9-46d5-9111-16d0cc5c79c9 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9" status: 404 len: 111 microversion: 2.1 time: 0.037019 Jun 07 04:56:38.614457 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 369/739] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:38 2022] GET /compute/v2.1/servers/a41c0f77-f2c7-4c2f-a303-7db1682da5d9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 04:56:38.806679 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:38.807295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:38.817440 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.818863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.820277 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.820742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.975517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:38.976127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:38.982706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.983161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:38.984416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:38.985118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:39.100090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:39.108648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:39.110891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:39.112210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6760b630-ee7e-47f4-ab1f-d43f8220b441 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.309899 Jun 07 04:56:39.118462 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 371/740] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:38 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:39.489608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:39.497676 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2fde6744-5fec-4008-b5be-35daa443a20b tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.525873 Jun 07 04:56:39.498247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 370/741] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:38 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:39.800049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:39.800549 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:39.807134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:39.807744 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:39.808366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:39.808824 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:39.822838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e HTTP/1.1 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:56:39.824427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.826059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '30fa9ff3-99a4-41d3-8492-a3a240d6d73e'} Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:39.830851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.832234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.833718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:39.833718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ebe2ef2a-5598-4304-b9f1-a8923f5a5c34 tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 404 len: 111 microversion: 2.1 time: 0.029729 Jun 07 04:56:39.833718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 372/742] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:56:39 2022] DELETE /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:39.839553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:39.840266 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] [instance: 30fa9ff3-99a4-41d3-8492-a3a240d6d73e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:39.847950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:39.848430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:39.849468 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:39.849978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:39.866055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] HTTP exception thrown: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Request method failure captured: Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e HTTP/1.1 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABinthOkD4aWDwCzTsRRx1PAwRdWbi9r-pauBE52wrYC-XbOiDbyHSkPCE6bJyOIg1VQjIB-DCprIRwCYX0XW2xy7MBuyOrAYtMb-_OKjOSJNY5oHF0EZrQKPmG4h0YMfy2Y9SCcJy14Ny9yUyFQ5Y1tocZZ6IJU_p4gLmz0cRAQvD1MD8 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:56:39.868148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37a2f67512cf46d58b5655cb15ce502d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37a2f67512cf46d58b5655cb15ce502d"}]}] Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 37a2f67512cf46d58b5655cb15ce502d Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475554405 Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 68a87c36e92b4dccbff62094846335f0 Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeTestJSON-475554405-project Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.870753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '30fa9ff3-99a4-41d3-8492-a3a240d6d73e'} Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:56:39.872317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. Jun 07 04:56:39.874173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:56:39.876026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] Returning 404 to user: Instance 30fa9ff3-99a4-41d3-8492-a3a240d6d73e could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:56:39.876026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-16fb898d-ae3b-490f-90aa-194f6bbcaccc tempest-AttachVolumeTestJSON-475554405 tempest-AttachVolumeTestJSON-475554405-project] 10.222.0.40 "GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e" status: 404 len: 111 microversion: 2.1 time: 0.034345 Jun 07 04:56:39.876026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 371/743] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:39 2022] GET /compute/v2.1/servers/30fa9ff3-99a4-41d3-8492-a3a240d6d73e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:56:40.132334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:40.133259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:40.147694 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:40.148533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:40.149544 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:40.149978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:40.459996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:40.467805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:40.471088 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:40.472445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bccc31b6-fafc-4059-951d-7b176caedd80 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1743 microversion: 2.20 time: 0.344782 Jun 07 04:56:40.483672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 373/744] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:40 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1743 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:40.514873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:40.516118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:40.527154 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:40.527481 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:40.534215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:40.534781 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:40.819421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:40.847146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9f864879-3738-4794-9d42-cf7d9a4055a1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1266 microversion: 2.1 time: 0.336037 Jun 07 04:56:40.856888 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 372/745] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:40 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:41.491667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:41.493052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:41.500400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:41.501485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:41.502584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:41.503224 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:41.649763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:41.657868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:41.659364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:41.660780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c17aff1a-612f-4109-9c7a-a5b0e74382a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1743 microversion: 2.20 time: 0.173372 Jun 07 04:56:41.671199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 374/746] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:41 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:41.864661 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:41.865325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:41.871775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:41.872244 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:41.873002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:41.873716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:42.013813 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:42.021301 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8dd6457f-f470-489b-a62c-7f35cd697054 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1453 microversion: 2.1 time: 0.160455 Jun 07 04:56:42.021871 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 373/747] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:41 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:56:42.037162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:42.037986 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:42.043911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:42.044363 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:42.045132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:42.045597 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:42.179678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:42.187854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0bdbc6bd-0e8e-40d5-ac12-0a133fd1d9f1 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1453 microversion: 2.1 time: 0.153899 Jun 07 04:56:42.188428 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 375/748] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:56:42 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:56:42.680222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:42.681437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:42.690597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:42.694141 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:42.695285 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:42.697345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:42.921129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:42.934879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:42.936813 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:42.941904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6855481e-3828-4733-bd26-1014bdc7201a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1743 microversion: 2.20 time: 0.267152 Jun 07 04:56:42.942787 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 374/749] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:42 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:56:43.962754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:43.962754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:43.970391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:43.971070 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:43.972266 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:43.972863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:44.233530 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:44.241737 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:44.243252 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:44.244445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b8047984-cdbd-4695-8f4b-a9207cf437ec tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1743 microversion: 2.20 time: 0.286504 Jun 07 04:56:44.245006 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 376/750] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:43 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:44.526870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-327ef260-8257-4806-98ce-1cdc30765165 req-61926eaf-6f5d-4afe-bd89-a837ca68ce9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "name": "network-vif-plugged", "status": "completed", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:44.548418 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-327ef260-8257-4806-98ce-1cdc30765165 req-61926eaf-6f5d-4afe-bd89-a837ca68ce9f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:44.553568 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-327ef260-8257-4806-98ce-1cdc30765165 req-61926eaf-6f5d-4afe-bd89-a837ca68ce9f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:44.574530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-327ef260-8257-4806-98ce-1cdc30765165 req-61926eaf-6f5d-4afe-bd89-a837ca68ce9f service nova] Creating event network-vif-plugged:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:56:44.583744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-327ef260-8257-4806-98ce-1cdc30765165 req-61926eaf-6f5d-4afe-bd89-a837ca68ce9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060167 Jun 07 04:56:44.585361 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 375/751] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:56:44.642480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-8a0344fa-2400-4ef6-ad6e-495be018a0f7 req-acdb28cd-e83b-4c6d-9452-c43e9efd0a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:56:44.655537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-8a0344fa-2400-4ef6-ad6e-495be018a0f7 req-acdb28cd-e83b-4c6d-9452-c43e9efd0a21 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:44.656741 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-8a0344fa-2400-4ef6-ad6e-495be018a0f7 req-acdb28cd-e83b-4c6d-9452-c43e9efd0a21 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:44.682270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-8a0344fa-2400-4ef6-ad6e-495be018a0f7 req-acdb28cd-e83b-4c6d-9452-c43e9efd0a21 service nova] Creating event network-changed:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:56:44.695769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-8a0344fa-2400-4ef6-ad6e-495be018a0f7 req-acdb28cd-e83b-4c6d-9452-c43e9efd0a21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057276 Jun 07 04:56:44.699816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 377/752] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:56:45.271124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:45.272028 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:45.279665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:45.280382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:45.281398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:45.281989 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:45.824620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:45.861248 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:45.862608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:45.878438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bf9dffb2-b54e-4ba1-b77b-798ca96247c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1743 microversion: 2.20 time: 0.619400 Jun 07 04:56:45.897008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 376/753] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:45 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1743 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:46.899457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:46.900148 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:46.910536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:46.912238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:46.913702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:46.914773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:47.185688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:47.202974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:47.204625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:47.206046 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b88f217b-b9e5-455c-92c0-eb51a7e409ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.311505 Jun 07 04:56:47.207335 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 378/754] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:46 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:48.231669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:48.232575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:48.273132 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:48.276275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:48.278423 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:48.279271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:48.582080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:48.599178 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:48.601640 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:48.604378 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0521cc22-9e3f-485f-be70-7e47d1ae94d8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.377679 Jun 07 04:56:48.605835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 377/755] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:48 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:49.625651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:49.626499 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:49.636029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:49.636726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:49.637739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:49.638436 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:49.840629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:49.853548 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:49.855669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:49.858052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-71cbde0a-d450-45a6-a374-b38a5080a4b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.237611 Jun 07 04:56:49.859420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 379/756] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:49 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:50.877950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:50.878602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:50.888464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:50.889320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:50.890401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:50.891066 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:51.064618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:51.074052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:51.076325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:51.078471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-87120ccb-638c-4e73-9346-839fa1dfdb32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.205425 Jun 07 04:56:51.090533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 378/757] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:50 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:52.097386 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:52.098018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:52.104852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:52.105578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:52.106515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:52.107122 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:52.290215 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:52.301127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:52.302953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:52.304332 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-64123732-9fa2-4ec2-9170-8ebdde59187a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.211413 Jun 07 04:56:52.305085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 380/758] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:52 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:53.326601 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:53.327324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:53.340870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:53.341261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:53.342183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:53.342810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:53.498145 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:53.509026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:53.511599 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:53.512987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a4a2a00f-f734-414e-b98b-1d6577eaf8a5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.190897 Jun 07 04:56:53.513744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 379/759] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:53 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:54.531995 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:54.532742 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:54.543545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:54.544321 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:54.546890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:54.547653 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:54.721146 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:54.733628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:54.736392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:54.738168 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6e095dbd-6067-4a80-97d6-aeff86d1132d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.210486 Jun 07 04:56:54.741416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 381/760] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:54 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:55.760607 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:55.761492 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:55.770595 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:55.771201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:55.772220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:55.772629 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:55.949439 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:55.959053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:55.960562 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:55.961785 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f6f339c2-1c22-4495-a486-7247bca955f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.205649 Jun 07 04:56:55.962537 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 380/761] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:55 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:56.981102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:56.981740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:56.988868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:56.989358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:56.990125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:56.990562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:57.119997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:57.129278 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:57.130783 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:57.131944 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-596480fe-43e3-4c9c-bc30-f205da209db9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1738 microversion: 2.20 time: 0.154766 Jun 07 04:56:57.132508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 382/762] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:56 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:58.150087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:58.150623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:58.157452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:58.158148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:58.158903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:58.159329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:58.292214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:58.300630 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:58.302180 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:58.303342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cc3fb3fb-5ca1-45b9-aadb-2a24c761dda5 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1720 microversion: 2.20 time: 0.157324 Jun 07 04:56:58.303899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 381/763] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:58 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:56:59.323875 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:56:59.324487 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:56:59.331550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:59.332004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:59.332772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:56:59.333245 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:56:59.470585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:59.478727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:59.480218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:56:59.481405 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-babf2c7c-7e0d-4bbd-84d0-3fb80bd9dd38 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1720 microversion: 2.20 time: 0.161384 Jun 07 04:56:59.481957 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 383/764] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:56:59 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:00.444493 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-4d078890-c74c-47e9-a9f6-b99b9196f701 req-7ffb9947-e98d-491d-b76f-c63ce3706f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "name": "network-vif-unplugged", "status": "completed", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:57:00.450465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=54 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:00.455304 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4d078890-c74c-47e9-a9f6-b99b9196f701 req-7ffb9947-e98d-491d-b76f-c63ce3706f4f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:00.455979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4d078890-c74c-47e9-a9f6-b99b9196f701 req-7ffb9947-e98d-491d-b76f-c63ce3706f4f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:00.467364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.compute.server_external_events [req-4d078890-c74c-47e9-a9f6-b99b9196f701 req-7ffb9947-e98d-491d-b76f-c63ce3706f4f service nova] Unable to find a host for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e. Dropping event network-vif-unplugged {{(pid=124422) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 04:57:00.468270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-4d078890-c74c-47e9-a9f6-b99b9196f701 req-7ffb9947-e98d-491d-b76f-c63ce3706f4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028137 Jun 07 04:57:00.468843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 382/765] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 04:57:00.499554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:00.500179 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:00.508242 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:00.508779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:00.509685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:00.510216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:00.649085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:00.657574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:00.659651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:00.660800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a2de8263-35f7-4551-9814-2422584fa0c0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1663 microversion: 2.20 time: 0.165550 Jun 07 04:57:00.661391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 384/766] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:00 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:00.678545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea1df28-016a-4840-833a-cdb326bd0a2b"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:57:00.679764 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:00.685934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:00.686470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:00.687319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:00.687818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:00.868495 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:00.974796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7e2bb95a-b99b-4da7-b98e-1e75b3777e77 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300348 Jun 07 04:57:00.975406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 383/767] 10.222.0.40 () {62 vars in 1363 bytes} [Tue Jun 7 04:57:00 2022] POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:57:01.093257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:57:01.093835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:01.100364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:01.100815 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:01.101630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:01.102101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:01.147971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=100 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:01.191116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-945728f4-b491-45b2-a18e-6489a779a2ed tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/action" status: 202 len: 0 microversion: 2.20 time: 0.101753 Jun 07 04:57:01.191733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 385/768] 10.222.0.40 () {62 vars in 1318 bytes} [Tue Jun 7 04:57:01 2022] POST /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:57:01.199850 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:01.200541 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:01.208064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:01.208521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:01.209469 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:01.210269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:01.348434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:01.357944 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:01.359440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:01.361007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-199bb752-c058-4d5b-b9c4-682c9c6e8c17 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1749 microversion: 2.20 time: 0.164729 Jun 07 04:57:01.361614 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 384/769] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:01 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:02.379956 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:02.380568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:02.389513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:02.389973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:02.390773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:02.391756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:02.526483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:02.534897 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:02.536403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:02.537588 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ae326fb6-81fa-42c7-a142-2a1426d30766 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1751 microversion: 2.20 time: 0.162101 Jun 07 04:57:02.538156 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 386/770] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:02 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:03.555187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:03.555803 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:03.562474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:03.562929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:03.564535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:03.564982 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:03.750522 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:03.760012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:03.761597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:03.762760 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9e386888-a018-4c3c-97ec-d1b164a656e6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.211488 Jun 07 04:57:03.763323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 385/771] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:03 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:04.780687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:04.781327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:04.794396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:04.794847 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:04.795626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:04.796713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:04.993864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:05.002845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:05.004526 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:05.006151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3887c475-3286-4517-b9a2-2bc36d955bf4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.229204 Jun 07 04:57:05.007166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 387/772] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:04 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:06.028299 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:06.030152 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:06.037580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:06.038114 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:06.039094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:06.039670 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:06.184555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:06.195135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:06.197501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:06.198851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fa37751b-3691-4355-b517-d6db09696db2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.175293 Jun 07 04:57:06.199889 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 386/773] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:06 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:07.217420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:07.218015 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:07.225941 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:07.226390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:07.227210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:07.227643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:07.364901 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:07.374837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:07.376835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:07.378066 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8da827db-c40a-4fce-868f-3c1fc1a61328 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.165286 Jun 07 04:57:07.378627 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 388/774] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:07 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:08.396074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:08.397472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:08.404392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:08.404838 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:08.416485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:08.416485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:08.574407 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:08.584775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:08.586959 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:08.588471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-917b17b6-ef78-4cda-8502-73828595e114 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.196453 Jun 07 04:57:08.589617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 387/775] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:08 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:09.609541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:09.611757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:09.615890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=39 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:09.619870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:09.620323 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:09.621165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:09.621629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:09.779409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:09.789791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:09.791655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:09.793750 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c27dcda1-f1ed-45f4-82c1-ab1beae3f2ad tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.189275 Jun 07 04:57:09.798415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 389/776] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:09 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:10.812906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:10.814897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:10.822459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:10.823182 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:10.824201 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:10.824846 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:11.028619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:11.038216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:11.039798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:11.041034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0895db02-a42f-4ef2-9be0-2f96f48f7264 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.232650 Jun 07 04:57:11.041706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 388/777] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:10 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:12.059745 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:12.060364 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:12.082135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:12.082595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:12.083389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:12.083833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:12.252519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:12.260931 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:12.262689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:12.263848 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-31121ed5-6dcd-4548-8081-cf8f66acbc28 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.208035 Jun 07 04:57:12.264410 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 390/778] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:12 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:13.286371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:13.287015 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:13.298222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:13.299287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:13.300078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:13.300519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:13.517771 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:13.530370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:13.532165 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:13.533380 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-685bb01f-9263-4298-b115-60bd08bbb12d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.254902 Jun 07 04:57:13.544269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 389/779] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:13 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:14.554874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:14.556502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:14.565825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:14.566347 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:14.567350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:14.568333 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:14.732013 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:14.740406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:14.741954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:14.743182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fe3676e0-e940-465f-9f5f-6d08ef4e84db tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.192446 Jun 07 04:57:14.743739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 391/780] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:14 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:15.762222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:15.762837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:15.769952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:15.770409 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:15.771181 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:15.771621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:15.901865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:15.911250 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:15.912749 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:15.913940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5e48dabf-4126-46a9-8885-438400c8a8f1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.155728 Jun 07 04:57:15.914505 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 390/781] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:15 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:16.932041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:16.932649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:16.939319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:16.939822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:16.940538 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:16.940972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:17.076120 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:17.085030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:17.086558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:17.087725 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-94c93b45-a16b-4fcb-9e4d-44cb1c837c67 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.159577 Jun 07 04:57:17.088281 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 392/782] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:16 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:18.106524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:18.107073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:18.114093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:18.114544 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:18.115308 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:18.115744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:18.243621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:18.252235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:18.253750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:18.254904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c35891f2-3e96-41e0-b28b-67dc911089a9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.152400 Jun 07 04:57:18.255461 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 391/783] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:18 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:19.272513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:19.273117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:19.279755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:19.280205 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:19.280961 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:19.281433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:19.415066 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:19.423971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:19.425513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:19.426670 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-69cdb888-2c12-4299-a22c-a401de6511a1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.158081 Jun 07 04:57:19.427232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 393/784] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:19 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:20.445287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:20.445902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:20.452559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:20.453008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:20.454452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:20.454912 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:20.588740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:20.597299 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:20.598801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:20.599957 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2d3b7b20-9f05-493a-83e7-20c5299197e1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.158655 Jun 07 04:57:20.600514 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 392/785] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:20 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:21.617556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:21.618162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:21.624921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:21.625341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:21.626437 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:21.626962 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:21.754570 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:21.762924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:21.764562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:21.765748 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2b36de12-f8de-43dc-b60c-e4c8b0876847 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.152002 Jun 07 04:57:21.766834 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 394/786] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:21 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:22.784704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:22.785843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:22.792390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:22.792852 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:22.793704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:22.794159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:22.929880 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:22.938173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:22.940636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:22.941847 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7c0b3a9f-5769-429f-afde-4693aa92019b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.161759 Jun 07 04:57:22.942401 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 393/787] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:22 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:23.960936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:23.961510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:23.967488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:23.967934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:23.968685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:23.969121 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:24.098556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:24.106831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:24.108324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:24.109542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4d76fda4-8373-4f1f-9261-1766117d530e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.152704 Jun 07 04:57:24.110145 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 395/788] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:23 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:25.127726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:25.128334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:25.134832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:25.135287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:25.136043 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:25.136478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:25.265244 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:25.273633 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:25.275166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:25.276333 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f448cb3-2411-426f-99f6-6797dc6f84dc tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.152905 Jun 07 04:57:25.276899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 394/789] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:25 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:26.294844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:26.295451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:26.302573 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:26.303016 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:26.303770 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:26.304201 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:26.433024 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:26.441679 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:26.443292 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:26.444450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cdb05fa3-1a6a-47b5-b12b-f9e5db632c6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.153566 Jun 07 04:57:26.445018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 396/790] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:26 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:27.462450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:27.463090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:27.470291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:27.470745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:27.471516 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:27.471964 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:27.609620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:27.619032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:27.620538 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:27.621751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-83fd0e71-1232-44fc-99e8-8f4d41f39ab7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.163245 Jun 07 04:57:27.622315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 395/791] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:27 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:28.640236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:28.640795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:28.647983 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:28.648426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:28.649182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:28.649688 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:28.785724 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:28.794144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:28.795692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:28.796842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0ae5c007-8d14-4e33-88f4-a0a6af8c439f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.160885 Jun 07 04:57:28.797466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 397/792] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:28 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:29.815222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:29.815832 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:29.822335 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:29.822776 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:29.823526 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:29.823953 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:29.956020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:29.964961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:29.966669 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:29.968028 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bce00fa8-1f09-444a-afcb-9db6dc6c134f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.156935 Jun 07 04:57:29.968574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 396/793] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:29 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:30.992651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:30.993790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:31.005611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:31.006395 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:31.007327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:31.007837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:31.145391 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:31.153701 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:31.155194 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:31.156350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9323ce25-b7b7-4012-b7eb-7d15c76051c4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.171767 Jun 07 04:57:31.157424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 398/794] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:30 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:32.176099 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:32.176734 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:32.179185 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=30 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:32.184498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:32.184948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:32.185725 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:32.186159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:32.191206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=84,nova_cell1:UPDATE=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:32.318906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:32.327298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:32.328861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:32.330045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6168ab60-4643-40eb-bb74-456896efe802 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.158621 Jun 07 04:57:32.330604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 397/795] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:32 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:33.347687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:33.348296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:33.354828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:33.355272 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:33.356039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:33.356473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:33.360413 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:33.490209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:33.498578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:33.500339 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:33.502396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2a016a6b-87a9-48c1-8bea-a393d87588c1 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.158810 Jun 07 04:57:33.502952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 399/796] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:33 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:34.520992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:34.521645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:34.528639 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:34.529097 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:34.529903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:34.530342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:34.659402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:34.667808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:34.669346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:34.670511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-82685451-02f5-49b5-afe9-62632d06f72a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.153429 Jun 07 04:57:34.671074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 398/797] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:34 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:35.687862 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:35.688500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:35.695072 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:35.695524 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:35.696289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:35.696725 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:35.831767 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:35.840348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:35.841907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:35.843073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c66c0191-5980-41d7-a08a-f4904c003f10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.159134 Jun 07 04:57:35.843628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 400/798] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:35 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:36.861151 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:36.862397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:36.868620 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:36.869134 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:36.869935 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:36.870381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:37.001428 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:37.009993 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:37.011513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:37.012674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c821d2bd-d17f-48e7-aaae-3271e352373a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.155454 Jun 07 04:57:37.013247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 399/799] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:36 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:38.030732 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:38.031352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:38.038387 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:38.038836 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:38.039602 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:38.040040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:38.166828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:38.175729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:38.177246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:38.178420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7e4878c2-5b6f-4743-86fe-ba5bb48fc5d7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.151658 Jun 07 04:57:38.178970 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 401/800] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:38 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:39.196416 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:39.197030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:39.203411 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:39.203861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:39.204614 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:39.205046 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:39.337021 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:39.345369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:39.346986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:39.348221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cad6a892-0c64-4fe2-a801-f9a1219827fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.155795 Jun 07 04:57:39.348779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 400/801] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:39 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:40.365678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:40.366293 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:40.368601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=26 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:57:40.373874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:40.374331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:40.375356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:40.375795 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:40.512306 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:40.526348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:40.528029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:40.529477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c3f0a974-7f7d-4c33-b32a-c72e32deec3e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.167636 Jun 07 04:57:40.530034 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 402/802] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:40 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:40.627636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-f7a9b92d-4d68-4236-9d72-722bf7ebef86 req-2a70989d-de33-49ef-98f3-2748fe8a95b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "name": "network-vif-plugged", "status": "completed", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:57:40.637675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-f7a9b92d-4d68-4236-9d72-722bf7ebef86 req-2a70989d-de33-49ef-98f3-2748fe8a95b0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:40.638234 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-f7a9b92d-4d68-4236-9d72-722bf7ebef86 req-2a70989d-de33-49ef-98f3-2748fe8a95b0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:40.650157 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-f7a9b92d-4d68-4236-9d72-722bf7ebef86 req-2a70989d-de33-49ef-98f3-2748fe8a95b0 service nova] Creating event network-vif-plugged:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:57:40.656015 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-f7a9b92d-4d68-4236-9d72-722bf7ebef86 req-2a70989d-de33-49ef-98f3-2748fe8a95b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Jun 07 04:57:40.657183 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 401/803] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:57:41.549102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:41.550409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:41.557720 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:41.558167 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:41.558944 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:41.559375 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:41.700649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:41.709618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:41.711117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:41.712492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d81708e7-6075-44d5-8c2e-64e8f1198378 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.168107 Jun 07 04:57:41.713401 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 403/804] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:41 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:42.732985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:42.733746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:42.740127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:42.740580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:42.741370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:42.741810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:42.870593 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:42.880189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:42.881601 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:42.882774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-32d456b8-9c31-4f0c-a6af-320234520615 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1807 microversion: 2.20 time: 0.154644 Jun 07 04:57:42.883336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 402/805] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:42 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:57:43.900620 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:57:43.901905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:57:43.908392 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:43.908846 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:43.909715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:57:43.910162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:57:44.054990 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:44.063634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:44.065127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:57:44.067154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0bc9ed75-d5b8-4cac-84cb-27bc1362c7e9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1794 microversion: 2.20 time: 0.170470 Jun 07 04:57:44.067709 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 404/806] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:57:43 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:58:48.512355 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=11 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:58:48.513191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=31 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:58:48.717515 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f36ff879-6787-47bf-bc5c-f834f1c7ac5d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Action: 'create', calling method: .version_select at 0x7f3d5de3e4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-943579736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6PTkMhnjqqlkS1s6IJUcLFmhpYEOP91730JKV8pQ3ZmnPUbJTyeqMVq0MFTo0YFlqUqO+MDp30ecvOG7aKuAEDcXGILffGthbERrmU2qEVAEc0ELYk4W/dIeJpGnMMzw=="}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:58:48.732568 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-f36ff879-6787-47bf-bc5c-f834f1c7ac5d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Getting quotas for project 310a8a0a65f74f29aa2b004903771f89. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:58:48.737022 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-f36ff879-6787-47bf-bc5c-f834f1c7ac5d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Getting quotas for user 23b946c6fc174c11a1c760d6583548cb and project 310a8a0a65f74f29aa2b004903771f89. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:58:48.766549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f36ff879-6787-47bf-bc5c-f834f1c7ac5d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.255863 Jun 07 04:58:48.767158 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 403/807] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 04:58:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:58:56.563563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 04:58:56.564164 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 04:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 04:59:03.670518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=5 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:03.671512 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=35 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:03.676139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:03.677043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:03.678712 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=4 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:03.679829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:03.691685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:03.692203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:03.693041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:03.693940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:03.719858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:59:03.742742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-52344d8d-ed12-4a88-a0c0-64c8b8d4670d req-0ee5647c-8c20-4c5b-9528-f88f3259359f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:03.754206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-52344d8d-ed12-4a88-a0c0-64c8b8d4670d req-0ee5647c-8c20-4c5b-9528-f88f3259359f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:03.754848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-52344d8d-ed12-4a88-a0c0-64c8b8d4670d req-0ee5647c-8c20-4c5b-9528-f88f3259359f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:03.771725 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-52344d8d-ed12-4a88-a0c0-64c8b8d4670d req-0ee5647c-8c20-4c5b-9528-f88f3259359f service nova] Creating event network-changed:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:59:03.779916 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-52344d8d-ed12-4a88-a0c0-64c8b8d4670d req-0ee5647c-8c20-4c5b-9528-f88f3259359f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106812 Jun 07 04:59:03.780962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 404/808] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:03.806634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-28b98b40-b25e-4d5f-a603-1fe63a0609ad tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 204 len: 0 microversion: 2.1 time: 0.137688 Jun 07 04:59:03.807334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 405/809] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:59:03 2022] DELETE /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:59:03.823013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:03.823720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:03.830990 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:03.831447 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:03.832256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:03.832761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:03.970080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:03.985273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e7503e24-8163-4a11-98e5-873610ba8076 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1578 microversion: 2.1 time: 0.165954 Jun 07 04:59:03.985273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 405/810] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:03 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:04.996172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:04.996882 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:05.003614 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:05.004064 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:05.004830 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:05.005291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:05.142731 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:05.150943 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d0a3a0da-f36f-4928-a593-dd595c9c49da tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1578 microversion: 2.1 time: 0.158965 Jun 07 04:59:05.151531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 406/811] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:04 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:06.168908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:06.169524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:06.175999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:06.176442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:06.177195 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:06.177652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:06.307083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:06.314611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-add67f7b-a886-4440-889d-66f9166e5e4a tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1459 microversion: 2.1 time: 0.150554 Jun 07 04:59:06.315185 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 406/812] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:06 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1459 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:07.331532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:07.332067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:07.338662 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:07.339111 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:07.339874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:07.340316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:07.470581 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:07.478557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1568c3bf-14c3-42ee-9e14-28492a6f5f76 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1459 microversion: 2.1 time: 0.150997 Jun 07 04:59:07.479130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 407/813] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:07 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1459 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:08.496007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:08.496567 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:08.503062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:08.503520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:08.504287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:08.504729 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:08.635671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:08.643196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-48df3062-7769-4715-9aac-c039fbbe85e0 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1459 microversion: 2.1 time: 0.151748 Jun 07 04:59:08.643758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 407/814] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:08 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:09.208425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-05eaad69-33af-483c-a00b-5e839adc96f2 req-8ba8bb01-ee14-470d-93f6-1811ec7db83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "name": "network-vif-unplugged", "status": "completed", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:09.216971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-05eaad69-33af-483c-a00b-5e839adc96f2 req-8ba8bb01-ee14-470d-93f6-1811ec7db83d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:09.217458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-05eaad69-33af-483c-a00b-5e839adc96f2 req-8ba8bb01-ee14-470d-93f6-1811ec7db83d service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:09.228683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-05eaad69-33af-483c-a00b-5e839adc96f2 req-8ba8bb01-ee14-470d-93f6-1811ec7db83d service nova] Creating event network-vif-unplugged:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:59:09.233769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-05eaad69-33af-483c-a00b-5e839adc96f2 req-8ba8bb01-ee14-470d-93f6-1811ec7db83d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150688 Jun 07 04:59:09.234288 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 408/815] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:09.660322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:09.660938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:09.667295 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:09.667739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:09.668498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:09.668933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:09.799968 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:09.808354 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7e5f2261-bcaf-4ea7-82ae-f3980217c383 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1459 microversion: 2.1 time: 0.151893 Jun 07 04:59:09.808922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 408/816] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:09 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:10.826556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:10.827174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:10.833309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:10.833764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:10.834519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:10.834955 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:11.199058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:11.206559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4fdf2ab7-e2e9-41c9-8311-6cb05e28ad05 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1459 microversion: 2.1 time: 0.384745 Jun 07 04:59:11.207121 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 409/817] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:10 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1459 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:11.271050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1812093714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-943579736", "security_groups": [{"name": "tempest-secgroup-smoke-40001538"}], "networks": [{"uuid": "d790c579-739d-46d7-b7b6-8d88548fb56f"}], "block_device_mapping_v2": [{"uuid": "2d615573-b116-434b-a6e9-a29c6e20897b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:11.382413 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] validate_networks() for [('d790c579-739d-46d7-b7b6-8d88548fb56f', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:59:11.864946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:59:11.865402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:59:11.865880 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:59:11.866283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:59:11.866849 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:59:11.875775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:11.876494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:11.877324 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:11.877763 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:11.894947 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Getting quotas for project 310a8a0a65f74f29aa2b004903771f89. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:59:11.899565 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Getting quotas for user 23b946c6fc174c11a1c760d6583548cb and project 310a8a0a65f74f29aa2b004903771f89. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:59:11.958585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:59:11.960726 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d615573-b116-434b-a6e9-a29c6e20897b',volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:59:12.097266 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-36809cdf-94d5-4c4a-bd04-fe71b4e82766 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.829585 Jun 07 04:59:12.103079 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 409/818] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 04:59:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 04:59:12.108918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c06d1b87-8d8a-479c-a99d-b96517a9478c tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:12.109647 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c06d1b87-8d8a-479c-a99d-b96517a9478c tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:12.183505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c06d1b87-8d8a-479c-a99d-b96517a9478c tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:12.197921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c06d1b87-8d8a-479c-a99d-b96517a9478c tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1088 microversion: 2.1 time: 0.085507 Jun 07 04:59:12.197921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 410/819] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:12 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:12.225377 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:12.226190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:12.234517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:12.235209 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:12.236101 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:12.236747 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:12.280758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-59879d02-2018-4b1b-b42f-ea5821877be7 req-d716001e-adc3-4b8d-888c-c11153c91a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e17e5f-1c19-4932-8dd4-81d196243bdc", "name": "network-vif-deleted", "tag": "700e2317-2556-4321-a885-cc99bce69558"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:12.299470 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-59879d02-2018-4b1b-b42f-ea5821877be7 req-d716001e-adc3-4b8d-888c-c11153c91a59 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:12.299919 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-59879d02-2018-4b1b-b42f-ea5821877be7 req-d716001e-adc3-4b8d-888c-c11153c91a59 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:12.313871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-59879d02-2018-4b1b-b42f-ea5821877be7 req-d716001e-adc3-4b8d-888c-c11153c91a59 service nova] Creating event network-vif-deleted:700e2317-2556-4321-a885-cc99bce69558 for instance a2e17e5f-1c19-4932-8dd4-81d196243bdc on hv-cinder-83699 Jun 07 04:59:12.319517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-59879d02-2018-4b1b-b42f-ea5821877be7 req-d716001e-adc3-4b8d-888c-c11153c91a59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046289 Jun 07 04:59:12.320265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 411/820] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:12.328035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:12.335731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-15542e63-fc42-412d-906b-abfa2de4bc12 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1391 microversion: 2.1 time: 0.115716 Jun 07 04:59:12.337272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 410/821] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:12 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1391 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:13.208940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:13.209577 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:13.216101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:13.216551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:13.217366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:13.217798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:13.288863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:13.297050 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5de622a8-8f6a-4ed5-a92c-9a6bcd5d29b6 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1130 microversion: 2.1 time: 0.092853 Jun 07 04:59:13.297695 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 412/822] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:13 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1130 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:13.355306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:13.355923 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:13.362374 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:13.362822 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:13.363576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:13.364007 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:13.395153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:13.395598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:13.396041 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lazy-loading 'fault' on Instance uuid a2e17e5f-1c19-4932-8dd4-81d196243bdc {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:59:13.438315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:13.446372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f19d5735-02b5-4deb-986f-fdb547abd7ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 200 len: 1230 microversion: 2.1 time: 0.094864 Jun 07 04:59:13.447425 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 411/823] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:13 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:14.313949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:14.314568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:14.321296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:14.321761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:14.322562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:14.322964 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:14.385348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:14.393332 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6598cc00-335f-4adb-aa0a-577821c0acb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1204 microversion: 2.1 time: 0.083184 Jun 07 04:59:14.393909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 413/824] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:14 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:14.464334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:14.464893 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: a2e17e5f-1c19-4932-8dd4-81d196243bdc] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:14.471404 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:14.471851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:14.472628 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:14.473065 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:14.488323 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] HTTP exception thrown: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Request method failure captured: Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc HTTP/1.1 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintiGHeKvNWwTSZ14-ILMqXtpJdMjV04BpmRvYBnSdKEmkzYsNXWxPOs4TRmMQm9j4hxDpczh89ILWMvqcuWuyJzE5t0ug7ElFjeixRjBCRKBLnRv5cSLjltRPNPj9ZEPxx-HyxMcdzbAGcYW2q7e_PlT4oqY1DKppiJEvXzBAqW_ns0 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:59:14.490027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e03f0a90584400b80b912510f02a228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e03f0a90584400b80b912510f02a228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}] Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: c4a16db9150f433e9b40545a7e68f2c5 Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. Jun 07 04:59:14.491608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'a2e17e5f-1c19-4932-8dd4-81d196243bdc'} Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:59:14.496745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. Jun 07 04:59:14.498429 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:14.500026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Returning 404 to user: Instance a2e17e5f-1c19-4932-8dd4-81d196243bdc could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:59:14.500026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0eba4198-311e-4d92-a3ef-d3c9d10e0498 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc" status: 404 len: 111 microversion: 2.1 time: 0.031460 Jun 07 04:59:14.500026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 412/825] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:14 2022] GET /compute/v2.1/servers/a2e17e5f-1c19-4932-8dd4-81d196243bdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:59:15.337011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-31b4990a-6787-48bb-881d-2363947929ab req-f4b9ad9e-31a6-4711-a8b9-9ec7b59354ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:15.352661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-31b4990a-6787-48bb-881d-2363947929ab req-f4b9ad9e-31a6-4711-a8b9-9ec7b59354ca service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:15.353131 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-31b4990a-6787-48bb-881d-2363947929ab req-f4b9ad9e-31a6-4711-a8b9-9ec7b59354ca service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:15.365546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-31b4990a-6787-48bb-881d-2363947929ab req-f4b9ad9e-31a6-4711-a8b9-9ec7b59354ca service nova] Creating event network-changed:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 04:59:15.371460 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-31b4990a-6787-48bb-881d-2363947929ab req-f4b9ad9e-31a6-4711-a8b9-9ec7b59354ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038013 Jun 07 04:59:15.372267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 414/826] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:15.410956 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:15.411582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:15.419449 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:15.420122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:15.420962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:15.421634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:15.570014 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:15.579391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9c211710-a09b-48f0-948e-321302493ae5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.171822 Jun 07 04:59:15.579974 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 413/827] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:15 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:16.597185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:16.597997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:16.605004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:16.605483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:16.606286 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:16.606732 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:16.738133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:16.746114 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-45b43176-2bb4-42d0-a110-9a7cbab77eff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.153466 Jun 07 04:59:16.746781 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 415/828] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:16 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:17.087738 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.088360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.095001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.095807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.096784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.097252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.128656 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-121c4586-acf1-42f9-aa63-506442f85c48 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments/dea1df28-016a-4840-833a-cdb326bd0a2b" status: 200 len: 194 microversion: 2.20 time: 0.046384 Jun 07 04:59:17.134616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 414/829] 10.222.0.40 () {60 vars in 1453 bytes} [Tue Jun 7 04:59:17 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments/dea1df28-016a-4840-833a-cdb326bd0a2b => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:59:17.203048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.203542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.210822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.211489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.212444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.212846 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.295314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lazy-loading 'services' on Instance uuid bbb81ec9-aca6-4774-86dc-2156f21c6a6e {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 04:59:17.369149 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9d9111dc-77e7-4c43-9774-4cd8e914ae23 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments/dea1df28-016a-4840-833a-cdb326bd0a2b" status: 202 len: 0 microversion: 2.20 time: 0.169998 Jun 07 04:59:17.369865 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 416/830] 10.222.0.40 () {60 vars in 1456 bytes} [Tue Jun 7 04:59:17 2022] DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments/dea1df28-016a-4840-833a-cdb326bd0a2b => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:59:17.378652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.379707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.387400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.387858 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.388635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.389443 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.420960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-830ca8e3-2eec-4494-b904-c5e27ad99387 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046643 Jun 07 04:59:17.421670 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 415/831] 10.222.0.40 () {60 vars in 1342 bytes} [Tue Jun 7 04:59:17 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 04:59:17.624772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.625367 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.635056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.635445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.636478 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.636930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.663845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:59:17.688779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-746e7c58-e561-4716-a11b-88f52617aa75 req-685b6d4d-0b0d-4b6e-8844-069849b755b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48f8409-8c4e-48de-a7e4-fa5cee12d801", "tag": "b435d72a-57d6-489d-9f94-452de03d3264"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:17.698091 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-746e7c58-e561-4716-a11b-88f52617aa75 req-685b6d4d-0b0d-4b6e-8844-069849b755b0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.698531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-746e7c58-e561-4716-a11b-88f52617aa75 req-685b6d4d-0b0d-4b6e-8844-069849b755b0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.710520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-746e7c58-e561-4716-a11b-88f52617aa75 req-685b6d4d-0b0d-4b6e-8844-069849b755b0 service nova] Creating event network-changed:b435d72a-57d6-489d-9f94-452de03d3264 for instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 on hv-cinder-83699 Jun 07 04:59:17.715926 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-746e7c58-e561-4716-a11b-88f52617aa75 req-685b6d4d-0b0d-4b6e-8844-069849b755b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093297 Jun 07 04:59:17.716817 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 416/832] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:17.750039 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e65e5ef2-94b7-4f26-b909-efb932aec859 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 204 len: 0 microversion: 2.1 time: 0.129114 Jun 07 04:59:17.750628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 417/833] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:59:17 2022] DELETE /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 04:59:17.759667 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.760366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.764473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:17.765661 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:17.767502 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.767952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.768736 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.769171 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.772453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.772913 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.774837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:17.774837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:17.987321 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:17.995716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:17.996489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-903340a2-f919-4318-bdb2-6b1a58911451 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1578 microversion: 2.1 time: 0.240943 Jun 07 04:59:17.997061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 417/834] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:17 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1578 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:18.004081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b16b489b-6e73-429a-a7d6-d8aa41d0770e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.244790 Jun 07 04:59:18.004764 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 418/835] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:17 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:59:18.435343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:18.436328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:18.443489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.444717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.446399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.446859 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.506897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0d231d3c-60cf-4369-a76f-b43ec576265c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.078223 Jun 07 04:59:18.507479 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 418/836] 10.222.0.40 () {60 vars in 1342 bytes} [Tue Jun 7 04:59:18 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:18.575365 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:18.575860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:18.588068 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.589193 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.589728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.590262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.620786 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 04:59:18.650138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:18.701142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9f6ba196-d837-451a-a4e1-248604578eb9 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 204 len: 0 microversion: 2.20 time: 0.130206 Jun 07 04:59:18.701751 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 419/837] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Jun 7 04:59:18 2022] DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 04:59:18.710085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:18.710737 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:18.719073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.719530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.720517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:18.720732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:18.863055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:18.871251 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:18.872757 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:18.873961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-56eebef5-3edf-48b4-bd86-4c9b26e4c9ca tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.167834 Jun 07 04:59:18.874527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 419/838] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:18 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:19.015227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:19.015934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:19.021440 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:19.022012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.022166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:19.022468 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:19.023244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.024273 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:19.028507 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.028958 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:19.029788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.030217 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:19.237536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:19.241911 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:19.246000 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e5cbcde6-b10e-44dc-9325-be57b31b8db5 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1578 microversion: 2.1 time: 0.234945 Jun 07 04:59:19.246669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 420/839] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:19 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:19.250254 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-04ff7bbd-c8a9-4372-b116-929f303b8fc8 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.232607 Jun 07 04:59:19.250813 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 420/840] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:19 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:19.892012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:19.892623 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:19.899493 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.900328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:19.901701 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:19.902494 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.035953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:20.044643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:20.046167 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:20.047324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fe3f283c-d56e-4221-8ed0-6c5fdfd8f407 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.159307 Jun 07 04:59:20.047879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 421/841] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:19 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:20.263631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:20.264247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:20.272188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:20.272388 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:20.272655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.272842 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:20.273471 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:20.275115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.279585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:20.280037 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.280818 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:20.281280 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.505697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a16db9150f433e9b40545a7e68f2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e03f0a90584400b80b912510f02a228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:20.509719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:20.514727 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-df9796a0-c9f2-4765-b2dc-61c6f5dbe9ce tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 200 len: 1460 microversion: 2.1 time: 0.254899 Jun 07 04:59:20.515421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 421/842] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:20 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 1460 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:20.517436 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e5ec3ad5-8c97-4fad-b808-95bfb9f74d3d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.248822 Jun 07 04:59:20.518019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 422/843] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:20 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:20.543508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-b54b40da-5251-45eb-981a-de6070f2ab61 req-f85436fc-b85e-4f29-9780-799d4c88881c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48f8409-8c4e-48de-a7e4-fa5cee12d801", "name": "network-vif-deleted", "tag": "b435d72a-57d6-489d-9f94-452de03d3264"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:20.551870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-b54b40da-5251-45eb-981a-de6070f2ab61 req-f85436fc-b85e-4f29-9780-799d4c88881c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:20.552394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-b54b40da-5251-45eb-981a-de6070f2ab61 req-f85436fc-b85e-4f29-9780-799d4c88881c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:20.564122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-b54b40da-5251-45eb-981a-de6070f2ab61 req-f85436fc-b85e-4f29-9780-799d4c88881c service nova] Creating event network-vif-deleted:b435d72a-57d6-489d-9f94-452de03d3264 for instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 on hv-cinder-83699 Jun 07 04:59:20.569528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-b54b40da-5251-45eb-981a-de6070f2ab61 req-f85436fc-b85e-4f29-9780-799d4c88881c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Jun 07 04:59:20.570129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 422/844] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:21.066135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:21.066671 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:21.073081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.073560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.074323 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.074779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.212809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:21.221001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:21.222559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:21.233937 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-39ba2116-6f44-487e-b78a-9f349eb4b31d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1722 microversion: 2.20 time: 0.171714 Jun 07 04:59:21.234534 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 423/845] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:21 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:21.532020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:21.532715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: d48f8409-8c4e-48de-a7e4-fa5cee12d801] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:21.535606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:21.536264 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:21.540446 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.541002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.541903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.543423 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.544138 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.544594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.545393 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:21.545825 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:21.558256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] HTTP exception thrown: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Request method failure captured: Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 HTTP/1.1 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintiGHeKvNWwTSZ14-ILMqXtpJdMjV04BpmRvYBnSdKEmkzYsNXWxPOs4TRmMQm9j4hxDpczh89ILWMvqcuWuyJzE5t0ug7ElFjeixRjBCRKBLnRv5cSLjltRPNPj9ZEPxx-HyxMcdzbAGcYW2q7e_PlT4oqY1DKppiJEvXzBAqW_ns0 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:59:21.560092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e03f0a90584400b80b912510f02a228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e03f0a90584400b80b912510f02a228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}] Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: c4a16db9150f433e9b40545a7e68f2c5 Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. Jun 07 04:59:21.561981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'd48f8409-8c4e-48de-a7e4-fa5cee12d801'} Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:59:21.563005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. Jun 07 04:59:21.564645 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:21.566052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Returning 404 to user: Instance d48f8409-8c4e-48de-a7e4-fa5cee12d801 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:59:21.566052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-37519a2b-2b30-40de-b2ff-a1de01de7137 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801" status: 404 len: 111 microversion: 2.1 time: 0.034764 Jun 07 04:59:21.566247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 423/846] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:21 2022] GET /compute/v2.1/servers/d48f8409-8c4e-48de-a7e4-fa5cee12d801 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:59:21.686910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:21.694892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9796b6ae-0257-4315-ab00-7a9331aafd14 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.165543 Jun 07 04:59:21.705678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 424/847] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:21 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 04:59:22.109540 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:22.110034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:22.111996 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:22.112650 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:22.119048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.119494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.120262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.120695 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.124979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:22.135188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] HTTP exception thrown: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Request method failure captured: Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 HTTP/1.1 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintiGHeKvNWwTSZ14-ILMqXtpJdMjV04BpmRvYBnSdKEmkzYsNXWxPOs4TRmMQm9j4hxDpczh89ILWMvqcuWuyJzE5t0ug7ElFjeixRjBCRKBLnRv5cSLjltRPNPj9ZEPxx-HyxMcdzbAGcYW2q7e_PlT4oqY1DKppiJEvXzBAqW_ns0 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 04:59:22.136733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e03f0a90584400b80b912510f02a228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e03f0a90584400b80b912510f02a228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}] Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: c4a16db9150f433e9b40545a7e68f2c5 Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.138454 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '3413578b-b03f-4a2b-b8a8-4f8515da19e2'} Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:59:22.139379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.140906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.142360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Returning 404 to user: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:59:22.142360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e76ed66f-dd78-4e96-9e82-d280228bec1e tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 404 len: 111 microversion: 2.1 time: 0.032629 Jun 07 04:59:22.142360 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 424/848] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 04:59:22 2022] DELETE /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:59:22.147137 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:22.147785 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] [instance: 3413578b-b03f-4a2b-b8a8-4f8515da19e2] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:22.154404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.154953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.155739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.156181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.170613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] HTTP exception thrown: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Request method failure captured: Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 HTTP/1.1 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintiGHeKvNWwTSZ14-ILMqXtpJdMjV04BpmRvYBnSdKEmkzYsNXWxPOs4TRmMQm9j4hxDpczh89ILWMvqcuWuyJzE5t0ug7ElFjeixRjBCRKBLnRv5cSLjltRPNPj9ZEPxx-HyxMcdzbAGcYW2q7e_PlT4oqY1DKppiJEvXzBAqW_ns0 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:59:22.172299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e03f0a90584400b80b912510f02a228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e03f0a90584400b80b912510f02a228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e03f0a90584400b80b912510f02a228"}]}] Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 5e03f0a90584400b80b912510f02a228 Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-TestVolumeBootPattern-477187217 Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: c4a16db9150f433e9b40545a7e68f2c5 Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-TestVolumeBootPattern-477187217-project Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.173727 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '3413578b-b03f-4a2b-b8a8-4f8515da19e2'} Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:59:22.175389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. Jun 07 04:59:22.176972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:22.178556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Returning 404 to user: Instance 3413578b-b03f-4a2b-b8a8-4f8515da19e2 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:59:22.178556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3a373714-0ecd-4cb3-99b9-f7654e2876d2 tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2" status: 404 len: 111 microversion: 2.1 time: 0.031319 Jun 07 04:59:22.178556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 425/849] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:22 2022] GET /compute/v2.1/servers/3413578b-b03f-4a2b-b8a8-4f8515da19e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 04:59:22.252529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:22.253198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:22.261621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.262379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.263172 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.263636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.339920 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:22.347766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:22.349399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:22.350559 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-22e875a8-b0d9-45a0-bd6c-d7ddd5acdc10 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 200 len: 1654 microversion: 2.20 time: 0.102689 Jun 07 04:59:22.351111 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 425/850] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:22 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 1654 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:22.584353 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-6c24eb8d-3d86-4209-b357-5fef35ec0d9a req-35be5e66-27d5-441e-8ff0-bf429e6d527e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb81ec9-aca6-4774-86dc-2156f21c6a6e", "name": "network-vif-deleted", "tag": "87e485d7-708c-4f18-be72-7c7e12ba457f"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:22.589268 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:22.595040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-6c24eb8d-3d86-4209-b357-5fef35ec0d9a req-35be5e66-27d5-441e-8ff0-bf429e6d527e service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.595485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-6c24eb8d-3d86-4209-b357-5fef35ec0d9a req-35be5e66-27d5-441e-8ff0-bf429e6d527e service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.607960 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-6c24eb8d-3d86-4209-b357-5fef35ec0d9a req-35be5e66-27d5-441e-8ff0-bf429e6d527e service nova] Creating event network-vif-deleted:87e485d7-708c-4f18-be72-7c7e12ba457f for instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e on hv-cinder-83699 Jun 07 04:59:22.612950 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-6c24eb8d-3d86-4209-b357-5fef35ec0d9a req-35be5e66-27d5-441e-8ff0-bf429e6d527e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Jun 07 04:59:22.613612 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 426/851] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:59:22.711923 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:22.712636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:22.719274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.719730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.720508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:22.720944 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:22.862546 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:22.871152 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b9f3d519-1c5c-4f9b-8005-ea11a5ad2a1b tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.163461 Jun 07 04:59:22.871754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 426/852] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:22 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:23.369087 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:23.369728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:23.376761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:23.377213 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:23.378038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:23.378617 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:23.391981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e HTTP/1.1 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 04:59:23.393683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 04:59:23.395457 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'bbb81ec9-aca6-4774-86dc-2156f21c6a6e'} Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 04:59:23.396424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 04:59:23.397911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 04:59:23.399958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 04:59:23.399958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-84b9a911-dce2-4d86-9a13-4fb8004f8b18 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 404 len: 111 microversion: 2.20 time: 0.030539 Jun 07 04:59:23.399958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 427/853] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:23 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 04:59:23.405128 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8dec8550-099f-4e3f-b234-9991ae92e31c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '.version_select at 0x7f3d5de53c10>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:23.424527 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8dec8550-099f-4e3f-b234-9991ae92e31c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770242850" status: 204 len: 0 microversion: 2.20 time: 0.023178 Jun 07 04:59:23.424989 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 427/854] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Jun 7 04:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770242850 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 04:59:23.482265 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-eed59ca2-76c8-4a2f-97af-657a0fbfa49c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] Calling method '.version_select at 0x7f3d5de6de50>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:23.504421 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-eed59ca2-76c8-4a2f-97af-657a0fbfa49c tempest-TestVolumeBootPattern-477187217 tempest-TestVolumeBootPattern-477187217-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1404641648" status: 202 len: 0 microversion: 2.1 time: 0.026169 Jun 07 04:59:23.505404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 428/855] 10.222.0.40 () {58 vars in 1262 bytes} [Tue Jun 7 04:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1404641648 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 04:59:23.888721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:23.889548 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:23.895658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:23.896184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:23.897059 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:23.897784 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:24.099251 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d72264a0-0288-4c3a-b64a-de6180a37c01 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: .version_select at 0x7f3d5dd80b80>, body: {"keypair": {"name": "tempest-keypair-608580946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4JbzTbKXIWDDHWCuqnCCMtc1vEQ4rmEoLMMM1OLkV3BrPSDSpNg2lqUtyi/1sqpzmZkRSmU2PJlbfMcfuoYnPnLBCrgrMqvp2sv9YSw24wysBUBM8oUbyq5OBuExmkqw=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:24.115940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-d72264a0-0288-4c3a-b64a-de6180a37c01 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:59:24.120813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-d72264a0-0288-4c3a-b64a-de6180a37c01 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for user 54eb57ad75144537b96ca90eb4e8f778 and project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:59:24.129816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:24.138526 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-75cee0f6-d51b-4fbf-af8b-bde40578fddf tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.254318 Jun 07 04:59:24.139272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 428/856] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:23 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:24.150338 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d72264a0-0288-4c3a-b64a-de6180a37c01 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055542 Jun 07 04:59:24.150935 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 429/857] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Jun 7 04:59:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 04:59:25.156839 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:25.157473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:25.169822 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:25.171797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:25.173265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:25.174187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:25.434872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:25.443589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-36a436f6-34c9-4e29-a9e9-3512309608cc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.291263 Jun 07 04:59:25.444473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 429/858] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:25 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:25.736810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-5849145", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63d492c6-7126-464a-9b77-1928c333c71e"}], "security_groups": [{"name": "tempest-securitygroup--879743140"}], "key_name": "tempest-keypair-608580946", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:25.850503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] validate_networks() for [('63d492c6-7126-464a-9b77-1928c333c71e', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 04:59:26.260452 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 04:59:26.261169 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 04:59:26.261704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 04:59:26.262110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 04:59:26.262517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 04:59:26.272131 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:26.272576 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:26.274315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:26.274771 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:26.292997 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 04:59:26.296925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Getting quotas for user 54eb57ad75144537b96ca90eb4e8f778 and project 015d0a41bd0340fcb9755a56fd7cbdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 04:59:26.310222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 04:59:26.314759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 04:59:26.343587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:26.366581 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4c6773d0-ff50-4856-80f8-16c2694e9282 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.634794 Jun 07 04:59:26.368778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 430/859] 10.222.0.40 () {62 vars in 1187 bytes} [Tue Jun 7 04:59:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 04:59:26.379583 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:26.380825 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:26.450329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:26.460844 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:26.461749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:26.468671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:26.469973 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:26.470665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:26.470786 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:26.471780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:26.471975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5c7df579-be03-4085-b641-c30f2020234f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1278 microversion: 2.20 time: 0.096674 Jun 07 04:59:26.472518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:26.474274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 430/860] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:26 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:26.634651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:26.642327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2fad724f-81d9-41d0-a1a9-b69a41c5f46e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.185376 Jun 07 04:59:26.643340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 431/861] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:26 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:27.238716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-446f0349-a1a9-4ad9-8529-44d34f2d0e4b req-03af9c1c-ccb4-44df-8fc3-2e354ff8ecbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "name": "network-vif-plugged", "status": "completed", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:27.249788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-446f0349-a1a9-4ad9-8529-44d34f2d0e4b req-03af9c1c-ccb4-44df-8fc3-2e354ff8ecbe service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:27.252196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-446f0349-a1a9-4ad9-8529-44d34f2d0e4b req-03af9c1c-ccb4-44df-8fc3-2e354ff8ecbe service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:27.270056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-446f0349-a1a9-4ad9-8529-44d34f2d0e4b req-03af9c1c-ccb4-44df-8fc3-2e354ff8ecbe service nova] Creating event network-vif-plugged:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 04:59:27.275934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-446f0349-a1a9-4ad9-8529-44d34f2d0e4b req-03af9c1c-ccb4-44df-8fc3-2e354ff8ecbe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040867 Jun 07 04:59:27.276624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 431/862] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 04:59:27.494197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:27.496159 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:27.504639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:27.505415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:27.506199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:27.506835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:27.591484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:27.599923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:27.602518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:27.603660 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-68dfef63-ae3f-41ec-bed2-bdd5148b5c6a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1338 microversion: 2.20 time: 0.116575 Jun 07 04:59:27.604237 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 432/863] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:27 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:27.661523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:27.662993 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:27.671590 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:27.672403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:27.673468 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:27.674236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:27.824010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:27.831996 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ca7b4f8d-141d-4cca-ae98-e182c531a2d1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.175927 Jun 07 04:59:27.832586 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 432/864] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:27 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:28.622096 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:28.622815 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:28.630449 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:28.630977 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:28.632008 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:28.632520 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:28.697926 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:28.707522 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:28.709171 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:28.710509 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2d90e53f-2470-4623-82f4-aaf853050245 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1336 microversion: 2.20 time: 0.092350 Jun 07 04:59:28.717056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 433/865] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:28 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:59:28.849127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:28.849866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:28.857192 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:28.857755 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:28.858534 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:28.858975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:28.999320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:29.007031 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fd543ad5-677f-497b-90be-792b2835dd80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1258 microversion: 2.1 time: 0.161793 Jun 07 04:59:29.008349 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 433/866] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:28 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:29.730222 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:29.731545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:29.738633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:29.739286 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:29.740139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:29.740649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:29.888276 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:29.897678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:29.900390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:29.901816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-07b25060-6fe5-438f-891f-1ef3b3f717aa tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.176592 Jun 07 04:59:29.902381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 434/867] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:29 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:30.024681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:30.025351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:30.032044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.032498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:30.033642 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.034026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:30.183571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:30.191554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3720710f-b3c5-4052-962f-b2d55cdf081a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1441 microversion: 2.1 time: 0.171451 Jun 07 04:59:30.192345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 434/868] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:30 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1441 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:30.208311 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:30.209182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:30.215256 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.215707 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:30.216481 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.216920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:30.357193 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:30.366589 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fed6b313-0f62-45dd-b6fe-d0a24dfe29e4 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1441 microversion: 2.1 time: 0.161987 Jun 07 04:59:30.367944 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 435/869] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 04:59:30 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 04:59:30.921668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:30.922546 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:30.930147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.930986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:30.932379 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:30.933019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:31.088551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-627f43cd-002f-4c31-95a9-0491cff1cc6b req-78dd5078-69b0-43de-83c9-b50a2c872a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:31.110123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-627f43cd-002f-4c31-95a9-0491cff1cc6b req-78dd5078-69b0-43de-83c9-b50a2c872a34 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:31.110947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-627f43cd-002f-4c31-95a9-0491cff1cc6b req-78dd5078-69b0-43de-83c9-b50a2c872a34 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:31.129598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-627f43cd-002f-4c31-95a9-0491cff1cc6b req-78dd5078-69b0-43de-83c9-b50a2c872a34 service nova] Creating event network-changed:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 04:59:31.151145 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-627f43cd-002f-4c31-95a9-0491cff1cc6b req-78dd5078-69b0-43de-83c9-b50a2c872a34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068623 Jun 07 04:59:31.152356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 436/870] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:59:31.285651 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:31.297342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:31.309751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:31.312403 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4fd41380-5653-4712-9113-cb2fcb60be53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.396241 Jun 07 04:59:31.323030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 435/871] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:30 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 04:59:32.343198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:32.345141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:32.355763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:32.356589 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:32.357649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:32.358379 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:32.393780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-4e5bf164-e6a6-44a2-8672-05ca28a9800b req-dab1cdd4-ce38-4c6b-afaa-00bc34ef0e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:32.407344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4e5bf164-e6a6-44a2-8672-05ca28a9800b req-dab1cdd4-ce38-4c6b-afaa-00bc34ef0e82 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:32.408148 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-4e5bf164-e6a6-44a2-8672-05ca28a9800b req-dab1cdd4-ce38-4c6b-afaa-00bc34ef0e82 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:32.435242 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-4e5bf164-e6a6-44a2-8672-05ca28a9800b req-dab1cdd4-ce38-4c6b-afaa-00bc34ef0e82 service nova] Creating event network-changed:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 04:59:32.442523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-4e5bf164-e6a6-44a2-8672-05ca28a9800b req-dab1cdd4-ce38-4c6b-afaa-00bc34ef0e82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052999 Jun 07 04:59:32.443981 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 436/872] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:59:32.545216 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:32.554672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:32.557270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:32.560132 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4cf1cae4-acf6-4e06-ac47-63675e49c3a8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.232434 Jun 07 04:59:32.561019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 437/873] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:32 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:33.579739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:33.581204 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:33.589766 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:33.590221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:33.591035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:33.591464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:33.745816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:33.750363 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:33.752167 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:33.753463 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cbb1bc66-5047-4007-8ba9-3889ef05e583 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.177881 Jun 07 04:59:33.754050 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 437/874] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:33 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:34.771936 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:34.772548 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:34.779130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:34.779589 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:34.780361 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:34.780797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:34.916863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:34.927965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:34.930117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:34.931713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-fcd29030-9e7d-471f-87d8-de797d34d406 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.163763 Jun 07 04:59:34.932323 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 438/875] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:34 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:35.950496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:35.951030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:35.953517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:35.958966 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:35.959506 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:35.960306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:35.960829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:36.093307 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:36.101159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:36.103671 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:36.104778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-48a617fe-ee46-4732-9774-c6076ede6723 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.158303 Jun 07 04:59:36.105364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 438/876] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:35 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:37.122672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:37.123279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:37.125689 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:37.126718 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=10 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:37.132381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:37.133390 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:37.134162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:37.134597 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:37.223571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-d9c33f98-6ee8-4741-959c-0451e5482286 req-9e01a18f-6ad5-4bed-b5fd-2f3f223b5704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "name": "network-vif-plugged", "status": "completed", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:37.227876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:37.234243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-d9c33f98-6ee8-4741-959c-0451e5482286 req-9e01a18f-6ad5-4bed-b5fd-2f3f223b5704 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:37.234691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-d9c33f98-6ee8-4741-959c-0451e5482286 req-9e01a18f-6ad5-4bed-b5fd-2f3f223b5704 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:37.247096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-d9c33f98-6ee8-4741-959c-0451e5482286 req-9e01a18f-6ad5-4bed-b5fd-2f3f223b5704 service nova] Creating event network-vif-plugged:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 04:59:37.252236 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-d9c33f98-6ee8-4741-959c-0451e5482286 req-9e01a18f-6ad5-4bed-b5fd-2f3f223b5704 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Jun 07 04:59:37.253026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 439/877] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 04:59:37.272864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:37.281687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:37.283200 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:37.284309 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c1ef7e37-4410-46e9-81c7-a54d1a644ec6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.165559 Jun 07 04:59:37.284862 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 439/878] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:37 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:38.303721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:38.304529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:38.310682 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:38.311142 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:38.311908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:38.312351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:38.446090 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:38.454312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:38.455805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:38.456897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0ebe11e0-c849-4d52-ac8c-d059d6103bd2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1403 microversion: 2.20 time: 0.157932 Jun 07 04:59:38.457485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 440/879] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:38 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:39.475038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:39.475680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:39.482788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:39.483236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:39.484005 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:39.484447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:39.612445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:39.615816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 04:59:39.622512 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:39.623998 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 04:59:39.625143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3304c758-9426-4f04-9220-daccffe18d94 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1595 microversion: 2.20 time: 0.154095 Jun 07 04:59:39.625754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 440/880] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 04:59:39 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 04:59:39.642337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 04:59:39.642854 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 04:59:39.649474 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:39.649930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:39.650720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:39.651160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:39.728597 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-88f1dd02-fda7-4e8e-99bc-f7d74b44d5b2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090105 Jun 07 04:59:39.729194 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 441/881] 10.222.0.40 () {60 vars in 1315 bytes} [Tue Jun 7 04:59:39 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 04:59:40.873773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-d18cfd18-00bc-412d-8dd0-aa22f18666df req-66eabc71-0502-4536-8a46-4cdefdf87240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 04:59:40.884195 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-d18cfd18-00bc-412d-8dd0-aa22f18666df req-66eabc71-0502-4536-8a46-4cdefdf87240 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 04:59:40.884637 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-d18cfd18-00bc-412d-8dd0-aa22f18666df req-66eabc71-0502-4536-8a46-4cdefdf87240 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 04:59:40.895852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-d18cfd18-00bc-412d-8dd0-aa22f18666df req-66eabc71-0502-4536-8a46-4cdefdf87240 service nova] Creating event network-changed:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 04:59:40.900733 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-d18cfd18-00bc-412d-8dd0-aa22f18666df req-66eabc71-0502-4536-8a46-4cdefdf87240 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030610 Jun 07 04:59:40.901539 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 441/882] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 04:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:00:55.861519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=7 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:00:55.862268 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=76 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:00:56.088371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:00:56.088843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:00:56.094966 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:56.095420 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:56.096196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:56.096636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:56.120155 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ebbc2f2b-b565-4906-9c1a-392e03121cc2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/ips" status: 200 len: 151 microversion: 2.20 time: 0.260677 Jun 07 05:00:56.120701 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 442/883] 10.222.0.40 () {60 vars in 1288 bytes} [Tue Jun 7 05:00:55 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/ips => generated 151 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 05:00:57.899881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=22 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:00:57.901307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:00:57.906358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:00:57.906971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:00:57.913890 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:57.914334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:57.915089 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:57.915518 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:57.937547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lazy-loading 'flavor' on Instance uuid 5a141055-103a-4642-8d6f-36ad52a6133f {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:00:58.194625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e1c6be31-26f1-4a95-bb63-e2b347f67472 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/action" status: 202 len: 0 microversion: 2.20 time: 0.296782 Jun 07 05:00:58.195250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 442/884] 10.222.0.40 () {62 vars in 1318 bytes} [Tue Jun 7 05:00:57 2022] POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:00:58.204008 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:00:58.204747 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:00:58.211219 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:58.211674 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:58.212448 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:58.212970 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:58.344048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:58.351934 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:58.353467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:58.354668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-86578d07-ed5a-4666-a0b1-13066b9b3287 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.154603 Jun 07 05:00:58.355223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 443/885] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:00:58 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:00:59.375235 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:00:59.375924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:00:59.382431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:59.382878 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:59.383630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:00:59.384060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:00:59.527095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:59.535258 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:59.536766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:00:59.537967 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a653f063-8b0f-446a-9b2d-d719359789dd tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.168516 Jun 07 05:00:59.538561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 443/886] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:00:59 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:00.558123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:00.558711 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:00.565149 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:00.565628 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:00.566388 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:00.566823 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:00.700952 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:00.709430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:00.710922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:00.712078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-087b3158-1b21-437a-babf-428e947b942a tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.158463 Jun 07 05:01:00.712960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 444/887] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:00 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:01.730831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:01.731474 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:01.738050 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:01.738498 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:01.739257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:01.739693 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:01.873880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:01.882082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:01.883588 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:01.885317 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a76e8635-0357-4c57-ac6b-d0625f474834 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.158692 Jun 07 05:01:01.885965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 444/888] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:01 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:02.904297 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:02.904897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:02.911389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:02.911835 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:02.912598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:02.913032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:03.040716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:03.049317 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:03.050809 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:03.051956 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e381229d-d7b0-4d23-85f1-0378c3b5ab6c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.152639 Jun 07 05:01:03.052512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 445/889] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:02 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:04.070291 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:04.070898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:04.077976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:04.078473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:04.079166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:04.079595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:04.206091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:04.214802 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:04.216308 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:04.217525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b66986a4-261e-4dc0-ad48-8b3467872b5c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.151039 Jun 07 05:01:04.218093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 445/890] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:04 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:05.235214 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:05.235858 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:05.242397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:05.242851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:05.243609 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:05.244045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:05.374813 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:05.382968 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:05.384484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:05.385672 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-399a083c-8014-487a-a4b9-4599bb842398 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.154338 Jun 07 05:01:05.386872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 446/891] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:05 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 05:01:06.404822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:06.405478 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:06.412611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:06.414753 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:06.415544 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:06.415994 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:06.549657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:06.557441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:06.559281 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:06.560472 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-414eaf0f-f69a-417d-b6c2-560be9fceee3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.160556 Jun 07 05:01:06.561030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 446/892] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:06 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:07.578339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:07.578948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:07.585492 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:07.585938 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:07.586696 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:07.587124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:07.720900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:07.728863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:07.731070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:07.732232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-03b33371-7364-4861-89e2-d6e98aa10312 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.157933 Jun 07 05:01:07.732798 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 447/893] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:07 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:08.750790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:08.751404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:08.758384 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:08.758833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:08.759594 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:08.760029 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:08.894620 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:08.903144 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:08.904656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:08.905852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-858a7d39-1f82-45ce-889b-3e146377beda tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.159004 Jun 07 05:01:08.906420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 447/894] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:08 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:09.923216 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:09.923943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:09.930545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:09.931002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:09.931807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:09.932246 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:10.066896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:10.074977 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:10.076462 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:10.077634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-66bb1293-5e50-44ae-9173-090de174d831 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1740 microversion: 2.20 time: 0.158375 Jun 07 05:01:10.078188 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 448/895] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:09 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:11.096474 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:11.097065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:11.103551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:11.103995 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:11.104808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:11.105334 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:11.234022 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:11.241933 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:11.243450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:11.244616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5429aa43-135b-40e1-96c7-b5904f62d321 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1740 microversion: 2.20 time: 0.152059 Jun 07 05:01:11.245176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 448/896] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:11 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:11.668478 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-dba6d610-91af-48e3-b7bb-be25e7324f29 req-b764fcad-4a1d-468d-b199-bc1fde95429c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "name": "network-vif-plugged", "status": "completed", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:11.677838 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-dba6d610-91af-48e3-b7bb-be25e7324f29 req-b764fcad-4a1d-468d-b199-bc1fde95429c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:11.678334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-dba6d610-91af-48e3-b7bb-be25e7324f29 req-b764fcad-4a1d-468d-b199-bc1fde95429c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:11.691554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-dba6d610-91af-48e3-b7bb-be25e7324f29 req-b764fcad-4a1d-468d-b199-bc1fde95429c service nova] Creating event network-vif-plugged:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 05:01:11.696794 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-dba6d610-91af-48e3-b7bb-be25e7324f29 req-b764fcad-4a1d-468d-b199-bc1fde95429c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032857 Jun 07 05:01:11.697488 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 449/897] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:01:12.264238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:12.264959 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:12.271374 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:12.271819 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:12.272585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:12.273018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:12.402258 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:12.410290 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:12.411773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:12.413049 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-492ed342-8a9e-4623-8ba3-1022753bef3f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1740 microversion: 2.20 time: 0.153656 Jun 07 05:01:12.413756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 449/898] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:12 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:13.434187 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:13.434932 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:13.441603 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:13.442051 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:13.442808 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:13.443239 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:13.580190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:13.588210 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:13.589860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:13.591016 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3188da64-7297-46a5-9b7e-4bf35b818e1c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1740 microversion: 2.20 time: 0.161714 Jun 07 05:01:13.591574 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 450/899] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:13 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:14.609456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:14.610060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:14.616549 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:14.616991 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:14.617780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:14.618211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:14.750982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:14.759427 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:14.760972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:14.762728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8dd1365e-bdb4-47f2-9e57-9e5e78fdabee tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1740 microversion: 2.20 time: 0.157698 Jun 07 05:01:14.763295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 450/900] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:14 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:15.783953 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:15.785215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:15.795573 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:15.796263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:15.797039 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:15.797507 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:15.959947 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:15.969591 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:15.971241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:15.972406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-09582864-2ac4-4bd0-b292-3d5662606d3c tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.194526 Jun 07 05:01:15.973139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 451/901] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:15 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:16.992143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:16.992685 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:16.999043 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:16.999488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:17.000261 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:17.000692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:17.154296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:17.162478 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:17.163982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:17.165252 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f6d4a300-fa52-4822-bb7e-068f22a308f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.176920 Jun 07 05:01:17.174234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 451/902] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:16 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:18.185213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:18.185975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:18.192598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:18.193030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:18.193865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:18.194350 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:18.361589 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:18.369745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:18.371963 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:18.373203 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8fd450f3-f7ac-4429-b2fb-9b91cf5ffb4b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.193272 Jun 07 05:01:18.373967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 452/903] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:18 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:19.392208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:19.392888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:19.399671 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:19.400128 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:19.400906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:19.401376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:19.541975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:19.550523 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:19.552055 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:19.553238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cd97002d-642b-4bcb-8342-b6f0a6bb1530 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.165178 Jun 07 05:01:19.553808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 452/904] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:19 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:20.571223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:20.572708 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:20.579630 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:20.580161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:20.581009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:20.581542 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:20.731412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:20.743792 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:20.746163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:20.747523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7d02c7e9-10fd-45de-8ab7-c5e34e0a58ff tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.180220 Jun 07 05:01:20.748265 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 453/905] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:20 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:21.767093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:21.767911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:21.775692 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:21.776146 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:21.777853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:21.778370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:21.941891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:21.950747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:21.952342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:21.953822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-74654e76-5208-4024-ad5a-9e4bab0a5052 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.191657 Jun 07 05:01:21.957259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 453/906] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:21 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:22.972897 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:22.973528 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:22.981035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:22.981508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:22.982280 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:22.982720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:23.125482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:23.134874 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:23.137616 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:23.139060 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-bea4c51e-5c4a-4711-9169-29dabf88fd62 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.170244 Jun 07 05:01:23.139621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 454/907] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:22 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:24.159669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:24.160282 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:24.166942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:24.168021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:24.168871 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:24.169412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:24.314984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:24.323295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:24.325337 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:24.326665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-21614978-b9e8-4126-8cac-83ccce610e32 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.171336 Jun 07 05:01:24.327227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 454/908] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:24 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:25.346273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:25.346812 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:25.353389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:25.353848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:25.354636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:25.355072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:25.485928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:25.493950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:25.496005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:25.497166 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-896c18a7-1cb8-4693-ab95-1c42439f34a3 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1735 microversion: 2.20 time: 0.154884 Jun 07 05:01:25.497797 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 455/909] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:25 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:26.516172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:26.516788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:26.523285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:26.523736 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:26.524502 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:26.524935 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:26.655089 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:26.662965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:26.664451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:26.665621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4fd126b1-1e9f-4fee-ade5-f90eac48701f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1717 microversion: 2.20 time: 0.153423 Jun 07 05:01:26.666176 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 455/910] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:26 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:27.689940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:27.690570 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:27.693052 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=29 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:27.698142 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:27.698681 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:27.699465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:27.699908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:27.703310 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=79 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:27.740282 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-bac1d42a-9282-40e5-8a7a-f28dc91c2114 req-9d16b754-1645-4fec-ad38-6b847c92d72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "name": "network-vif-unplugged", "status": "completed", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:27.752867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-bac1d42a-9282-40e5-8a7a-f28dc91c2114 req-9d16b754-1645-4fec-ad38-6b847c92d72b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:27.753860 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-bac1d42a-9282-40e5-8a7a-f28dc91c2114 req-9d16b754-1645-4fec-ad38-6b847c92d72b service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:27.768949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-bac1d42a-9282-40e5-8a7a-f28dc91c2114 req-9d16b754-1645-4fec-ad38-6b847c92d72b service nova] Creating event network-vif-unplugged:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 05:01:27.775014 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-bac1d42a-9282-40e5-8a7a-f28dc91c2114 req-9d16b754-1645-4fec-ad38-6b847c92d72b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039483 Jun 07 05:01:27.775909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 456/911] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:01:27.848531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:27.857233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:27.858773 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:27.859931 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3ab46d0c-d0c8-44ba-86ef-a7521f4bc5d2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1717 microversion: 2.20 time: 0.179685 Jun 07 05:01:27.860487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 456/912] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:27 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:28.878787 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:28.879477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:28.881492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=31 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:28.886965 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:28.887412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:28.888168 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:28.888597 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:28.892609 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:29.017370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:29.025109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:29.027192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:29.028346 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f3663875-95bd-456f-a306-d82f5304fd53 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1660 microversion: 2.20 time: 0.154562 Jun 07 05:01:29.028896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 457/913] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:28 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1660 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:29.045768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36be6728-18d1-4e0f-9fc8-fe39477e8d46"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:29.046865 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:29.053445 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.053895 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.054659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.055097 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.313002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c0fbcf38-7cff-470d-9860-b9d6814cac65 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.271396 Jun 07 05:01:29.313631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 457/914] 10.222.0.40 () {62 vars in 1363 bytes} [Tue Jun 7 05:01:29 2022] POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments => generated 188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 05:01:29.425810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:29.426333 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:29.433009 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.433505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.434349 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.434793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.681925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0d3cedb4-cf86-4703-89f3-ed8e328c13a4 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments/36be6728-18d1-4e0f-9fc8-fe39477e8d46" status: 202 len: 0 microversion: 2.20 time: 0.259951 Jun 07 05:01:29.682631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 458/915] 10.222.0.40 () {60 vars in 1456 bytes} [Tue Jun 7 05:01:29 2022] DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments/36be6728-18d1-4e0f-9fc8-fe39477e8d46 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:01:29.741037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:29.741656 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:29.748208 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.748660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.749489 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.749950 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.840196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1a98f862-8b7c-48f5-a263-1b5f236a4057 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/action" status: 202 len: 0 microversion: 2.20 time: 0.102783 Jun 07 05:01:29.840800 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 458/916] 10.222.0.40 () {62 vars in 1318 bytes} [Tue Jun 7 05:01:29 2022] POST /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:01:29.848876 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:29.849517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:29.856058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.856505 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.857297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:29.857738 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:29.995898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:30.005939 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:30.007549 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:30.008716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-97ed5773-4c38-48d8-ad06-87ca2d1a19f7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1668 microversion: 2.20 time: 0.163765 Jun 07 05:01:30.009295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 459/917] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:29 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:31.028135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:31.028739 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:31.035493 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:31.035953 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:31.036689 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:31.037120 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:31.164658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:31.173139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:31.174655 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:31.175799 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e2118f3f-22e9-4886-a573-e4c37031265b tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1668 microversion: 2.20 time: 0.152342 Jun 07 05:01:31.176371 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 459/918] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:31 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:32.194485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:32.195035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:32.201772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:32.202213 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:32.202968 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:32.203403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:32.333376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:32.342034 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:32.343521 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:32.344672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-63967854-f4bd-4d24-b258-d4f6fc25bd6e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1668 microversion: 2.20 time: 0.154215 Jun 07 05:01:32.345234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 460/919] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:32 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:33.363394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:33.364024 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:33.371078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:33.371518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:33.372267 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:33.372696 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:33.502524 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:33.510902 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:33.512406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:33.513606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9f996905-bebd-4543-84fc-2eecb82fb3f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1668 microversion: 2.20 time: 0.154043 Jun 07 05:01:33.514167 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 460/920] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:33 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:34.531831 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:34.532445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:34.538966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:34.539422 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:34.540187 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:34.540625 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:34.682963 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:34.691218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:34.692723 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:34.693910 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ae1ab6a1-e5c5-4d62-89bb-41b0712d79fb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1668 microversion: 2.20 time: 0.165985 Jun 07 05:01:34.694469 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 461/921] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:34 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:35.711053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:35.711805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:35.718576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:35.719026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:35.719807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:35.720243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:35.851651 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:35.863483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:35.865455 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:35.866636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f6abe786-8196-4a96-8e8b-d4992cdbf5b0 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.159543 Jun 07 05:01:35.867344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 461/922] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:35 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:36.890167 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:36.891342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:36.899110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:36.899477 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:36.900249 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:36.900678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:37.042624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:37.050857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:37.052358 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:37.053592 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-01c80135-07c6-4e1e-9d7f-9343443da730 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.171596 Jun 07 05:01:37.054599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 462/923] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:36 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:37.595596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:01:37.596186 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:01:38.070978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:38.071691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:38.078922 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:38.079365 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:38.080123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:38.080554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:38.227279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:38.236606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:38.238472 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:38.239634 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-18528aed-c363-4010-92fb-7341ffa76350 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.172692 Jun 07 05:01:38.240190 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 462/924] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:38 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:39.258585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:39.259422 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:39.266346 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:39.266791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:39.267565 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:39.267996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:39.404999 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:39.414551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:39.416045 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:39.417213 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-408c427d-1f38-46b9-bd52-01278243dd60 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.162549 Jun 07 05:01:39.418150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 463/925] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:39 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:40.435875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:40.437192 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:40.443918 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:40.444366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:40.445131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:40.445585 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:40.592006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:40.600272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:40.601815 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:40.602992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fdccb9b2-fed1-457a-a29f-d8ad35c20cc7 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.170990 Jun 07 05:01:40.603720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 463/926] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:40 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:41.620909 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:41.621563 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:41.628489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:41.628938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:41.629729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:41.630165 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:41.772908 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:41.781497 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:41.783227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:41.784536 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-06d93deb-d467-4c7a-b3d1-40ba5a4dbb8e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.167492 Jun 07 05:01:41.785328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 464/927] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:41 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:42.805731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:42.806328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:42.813501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:42.813899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:42.814725 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:42.815198 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:42.963775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:42.972800 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:42.974325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:42.975473 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8d616389-41a2-4352-af15-cde77801ed1f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.175731 Jun 07 05:01:42.976032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 464/928] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:42 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:43.993638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:43.994238 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:44.000705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:44.001157 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:44.001974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:44.002413 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:44.142177 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:44.150870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:44.152361 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:44.153532 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0c00a1a4-e375-4d3e-9237-a2153036b607 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.163900 Jun 07 05:01:44.154077 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 465/929] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:43 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:45.174464 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:45.175315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:45.184217 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:45.184666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:45.185483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:45.185920 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:45.320885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:45.329006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:45.330642 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:45.331820 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f518c75-0226-4ee4-a8c6-452c1f4bc0c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.161976 Jun 07 05:01:45.332647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 465/930] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:45 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:46.350642 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:46.351232 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:46.357658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:46.358103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:46.358854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:46.359282 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:46.491315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:46.499103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:46.500585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:46.501758 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-29f5a75b-efd8-4583-8c64-be993e2ea0f6 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.155460 Jun 07 05:01:46.503103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 466/931] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:46 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:47.043777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:47.044402 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:47.050860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.051302 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.052051 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.052482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.074377 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lazy-loading 'flavor' on Instance uuid 58288984-7973-49e9-ac43-100c1b00e159 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:01:47.143697 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f3a01d9-2cd8-4621-8b63-84b7713a8f8f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "POST /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159/action" status: 202 len: 0 microversion: 2.1 time: 0.103642 Jun 07 05:01:47.144279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 466/932] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 05:01:47 2022] POST /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:01:47.152313 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:47.152911 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:47.159585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.160030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.160779 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.161209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.293925 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:47.301593 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-8bd1320d-b135-4fe6-a29a-a86c87aa6870 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.153064 Jun 07 05:01:47.302188 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 467/933] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:47 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:47.522200 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:47.522903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:47.529116 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.529604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.530372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:47.530814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:47.533452 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:47.664811 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:47.672788 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:47.675085 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:47.676261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a84f3e88-dc06-4c02-a169-3af5395a0fcb tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.158395 Jun 07 05:01:47.676830 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 467/934] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:47 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:48.320160 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:48.320805 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:48.327274 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:48.327715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:48.328466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:48.328897 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:48.457090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:48.464503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9c185516-a4ca-427d-bab3-ef08f9bcbf35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.148826 Jun 07 05:01:48.465063 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 468/935] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:48 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:48.694343 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:48.694962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:48.701582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:48.702034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:48.702801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:48.703241 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:48.830517 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:48.838431 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:48.839945 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:48.841412 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ae11c6cc-385c-4049-a434-38ef3aafbb74 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.150970 Jun 07 05:01:48.841987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 468/936] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:48 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:49.482001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:49.482610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:49.489151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:49.489633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:49.490396 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:49.490832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:49.640196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:49.648067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-04f30cba-2c2d-47c1-8aa4-dcefe1ac9177 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.169882 Jun 07 05:01:49.648644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 469/937] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:49 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:49.864292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:49.864898 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:49.871336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:49.871780 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:49.872536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:49.872969 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:50.007958 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:50.015785 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:50.020666 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:50.022373 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-06350ae3-8da0-491c-96ed-552a8d28f9c2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.162453 Jun 07 05:01:50.022935 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 469/938] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:49 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:50.666123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:50.666740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:50.676674 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:50.677269 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:50.678102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:50.678529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:50.816595 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:50.823996 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-86d51e27-ddbf-4a92-9946-e259ecde0be1 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.161792 Jun 07 05:01:50.824556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 470/939] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:50 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:51.040194 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:51.040804 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:51.047269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:51.047720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:51.049071 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:51.049751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:51.177824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:51.185765 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:51.187252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:51.188391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d1b29708-020a-4a6b-b5cf-4d2d6020530d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.152108 Jun 07 05:01:51.188943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 470/940] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:51 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:51.840896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:51.841586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:51.848663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:51.849109 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:51.850178 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:51.850613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:51.854801 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:01:51.997872 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:52.005759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-541e87d5-24cc-4944-afde-aa82783c1810 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.168667 Jun 07 05:01:52.006340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 471/941] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:51 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:52.206837 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:52.207382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:52.213857 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:52.214303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:52.215053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:52.215483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:52.359157 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:52.367434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:52.368967 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:52.370215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-22074974-22e0-4c03-a552-982b45ca261f tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.167860 Jun 07 05:01:52.370799 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 471/942] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:52 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:53.022185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:53.022809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:53.028769 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:53.029217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:53.030007 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:53.030445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:53.159845 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:53.167466 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-16b87a71-2d83-407e-933d-28221420e415 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.149363 Jun 07 05:01:53.168038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 472/943] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:53 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:53.389106 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:53.389689 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:53.397045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:53.397533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:53.398287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:53.398720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:53.528232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:53.536772 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:53.538282 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:53.539432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5a65366a-e034-443b-835b-8c4270f0388e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.154350 Jun 07 05:01:53.539987 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 472/944] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:53 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:53.921117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-00938359-55e8-4dfd-9408-57c2fa544897 req-460d816c-1b6c-4567-b92d-e718215cde10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "name": "network-vif-plugged", "status": "completed", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:01:53.930630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-00938359-55e8-4dfd-9408-57c2fa544897 req-460d816c-1b6c-4567-b92d-e718215cde10 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:53.931185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-00938359-55e8-4dfd-9408-57c2fa544897 req-460d816c-1b6c-4567-b92d-e718215cde10 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:53.944812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-00938359-55e8-4dfd-9408-57c2fa544897 req-460d816c-1b6c-4567-b92d-e718215cde10 service nova] Creating event network-vif-plugged:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 05:01:53.949719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-00938359-55e8-4dfd-9408-57c2fa544897 req-460d816c-1b6c-4567-b92d-e718215cde10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Jun 07 05:01:53.950317 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 473/945] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:01:54.185372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:54.185986 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:54.192838 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:54.193396 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:54.194233 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:54.194664 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:54.325073 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:54.332576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3905daf4-5a9f-468f-8e1f-9898ed14d356 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.151048 Jun 07 05:01:54.333140 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 473/946] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:54 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:54.559880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:54.560575 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:54.566868 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:54.567315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:54.568095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:54.568514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:54.701327 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:54.710038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:54.711535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:54.712707 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0d2d2817-0d5f-4606-8b29-2e2c75e645df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.157578 Jun 07 05:01:54.713274 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 474/947] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:54 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:55.350123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:55.350719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:55.357290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:55.357746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:55.358500 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:55.358939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:55.488205 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:55.495706 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a82115a7-2ca9-433b-8962-6363863ba818 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.149431 Jun 07 05:01:55.496274 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 474/948] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:55 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:55.731119 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:55.731729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:55.739028 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:55.739476 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:55.740227 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:55.740654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:55.870826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:55.879244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:55.880766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:55.881976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a651bcbd-5d43-4118-a074-baaf63fb88ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1726 microversion: 2.20 time: 0.154798 Jun 07 05:01:55.882542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 475/949] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:55 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:56.512298 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:56.512919 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:56.520252 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:56.520707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:56.521499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:56.521943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:56.660348 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:56.668081 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-440fbd72-d48c-42f5-b493-a29ae9a1b7b9 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.159689 Jun 07 05:01:56.668641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 475/950] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:56 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:56.902583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:56.903369 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:56.909953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:56.910402 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:56.911160 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:56.911592 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:57.038514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:57.046426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:57.047924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:57.049262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-61ee5a79-1f18-47d6-a131-6ed168f63867 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1713 microversion: 2.20 time: 0.150927 Jun 07 05:01:57.049851 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 476/951] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:01:56 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:01:57.685617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:57.686225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:57.692903 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:57.693390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:57.694146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:57.694581 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:57.830123 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:57.837561 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-3f72e29e-83e5-4bb8-8344-fe84bc6d5980 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.155735 Jun 07 05:01:57.838129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 476/952] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:57 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:01:58.855366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:01:58.855982 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:01:58.862835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:58.863285 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:58.864047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:01:58.864485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:01:58.996773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:01:59.005012 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-48177458-0a05-48ce-b961-e7295f8eebf2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.153708 Jun 07 05:01:59.005628 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 477/953] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:01:58 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:00.022740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:00.023363 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:00.025962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=44 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:00.031602 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:00.032056 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:00.032868 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:00.033329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:00.164331 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:00.171994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-46efb7ac-289e-4c5d-a4bd-4a95063f0ee5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.153232 Jun 07 05:02:00.172557 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 477/954] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:00 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 05:02:01.190329 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:01.190828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:01.194634 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=42 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:01.202403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:01.202852 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:01.204127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:01.205051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:01.364838 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:01.372574 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-70466e89-5933-401a-92dc-0fe72f2b1aca tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.186683 Jun 07 05:02:01.373173 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 478/955] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:01 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:02.390483 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:02.391094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:02.397816 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:02.398263 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:02.399032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:02.399461 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:02.530752 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:02.538729 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7c3fb02b-9736-46e3-bef5-dcaabe359e35 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.152107 Jun 07 05:02:02.539289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 478/956] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:02 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:03.557591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:03.558314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:03.566409 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:03.566862 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:03.567629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:03.568064 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:03.595597 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:02:03.599516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 (ip 10.222.0.40) !!! Jun 07 05:02:03.712777 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:03.723196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-011124c1-6e4d-4a0f-9323-45fd4c41934a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.169311 Jun 07 05:02:03.723780 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 479/957] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:03 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:04.740826 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:04.741470 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:04.747929 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:04.748374 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:04.749124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:04.749580 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:04.953851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:04.962120 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-de5246e4-e623-4221-b911-a123f80dfbed tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1507 microversion: 2.1 time: 0.225571 Jun 07 05:02:04.962686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 479/958] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:04 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:04.980082 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:02:04.981196 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:04.988962 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:04.989441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:04.990209 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:04.990646 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:05.066011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-50d552e2-986b-48da-80f2-02d34b31f957 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "POST /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159/action" status: 202 len: 0 microversion: 2.1 time: 0.090539 Jun 07 05:02:05.066610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 480/959] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Jun 7 05:02:04 2022] POST /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 05:02:05.074704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:05.075318 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:05.081346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:05.081800 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:05.082566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:05.083194 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:05.249433 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:05.257819 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e608147f-a6b1-4bcd-9285-36abb3fdd07e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1515 microversion: 2.1 time: 0.186923 Jun 07 05:02:05.258768 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 480/960] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:05 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:05.949557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-034477f9-153b-412a-9b29-a4a7de8baf04 req-bf71a3ce-99c4-4cf4-9160-fe67c3e7d851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "name": "network-vif-unplugged", "status": "completed", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:02:05.958647 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-034477f9-153b-412a-9b29-a4a7de8baf04 req-bf71a3ce-99c4-4cf4-9160-fe67c3e7d851 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:05.959234 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-034477f9-153b-412a-9b29-a4a7de8baf04 req-bf71a3ce-99c4-4cf4-9160-fe67c3e7d851 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:05.971655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.compute.server_external_events [req-034477f9-153b-412a-9b29-a4a7de8baf04 req-bf71a3ce-99c4-4cf4-9160-fe67c3e7d851 service nova] Unable to find a host for instance 58288984-7973-49e9-ac43-100c1b00e159. Dropping event network-vif-unplugged {{(pid=124421) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 05:02:05.972492 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-034477f9-153b-412a-9b29-a4a7de8baf04 req-bf71a3ce-99c4-4cf4-9160-fe67c3e7d851 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026803 Jun 07 05:02:05.973091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 481/961] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 05:02:06.275551 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:06.276196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:06.282721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:06.283167 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:06.283970 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:06.284394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:06.428184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:06.436724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d3934921-82c7-495c-9476-6bfbe29ecd1a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1517 microversion: 2.1 time: 0.165019 Jun 07 05:02:06.438130 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 481/962] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:06 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:07.456525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:07.457041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:07.463476 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:07.463928 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:07.464736 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:07.465173 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:07.666080 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:07.674458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-99fd1c9f-a378-41cf-9654-9c0cd6156726 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.222030 Jun 07 05:02:07.675251 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 482/963] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:07 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:08.692159 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:08.692775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:08.699072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:08.699522 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:08.700290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:08.700724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:08.828813 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:08.836476 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-02b5067a-4da0-40a7-89e2-cc91e1f914c2 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.148843 Jun 07 05:02:08.837038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 482/964] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:08 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:09.853904 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:09.854515 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:09.860946 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:09.861918 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:09.862676 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:09.863112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:09.994453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:10.002517 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a412c2b0-9921-4fa5-95bd-2365dce7faf5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.151854 Jun 07 05:02:10.003345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 483/965] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:09 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:11.020444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:11.021092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:11.027529 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:11.027978 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:11.028761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:11.029209 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:11.156480 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:11.158777 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=100 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:11.165352 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fb5c90e4-bb83-4595-9f74-97fd9acc0625 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.149697 Jun 07 05:02:11.165917 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 483/966] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:11 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:12.184093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:12.184704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:12.191749 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:12.192202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:12.192963 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:12.193424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:12.326423 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:12.334654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2406dbe4-bb12-4284-9076-48d8d6248c51 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.154437 Jun 07 05:02:12.335260 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 484/967] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:12 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:13.352061 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:13.352658 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:13.359351 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:13.359801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:13.360560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:13.360999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:13.489787 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:13.497366 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-333abbf4-6218-4f59-ad98-8b18832ba48e tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.149731 Jun 07 05:02:13.497989 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 484/968] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:13 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:14.515040 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:14.515676 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:14.522815 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:14.523259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:14.524011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:14.524441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:14.655145 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:14.663520 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0463dd04-4556-408d-ab75-58e3ffc0ae62 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.152294 Jun 07 05:02:14.664096 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 485/969] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:14 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:15.680662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:15.681292 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:15.688143 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:15.688921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:15.689400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:15.689919 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:15.823172 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:15.831224 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-acd416d7-cb3e-4dca-be17-06a6b3b3bfba tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.154486 Jun 07 05:02:15.831789 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 485/970] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:15 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:16.851556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:16.851556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:16.856406 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:16.856888 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:16.857716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:16.858177 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:16.989930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:16.997404 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-4a6dafc3-f3ec-4e90-96cf-34ebe2072603 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.153462 Jun 07 05:02:16.997971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 486/971] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:16 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:18.015045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:18.015662 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:18.022680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:18.023129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:18.023896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:18.024339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:18.394805 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:18.402319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e497d4f8-2c32-405a-9ec1-ef8853702bb3 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.391256 Jun 07 05:02:18.402884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 486/972] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:18 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:19.419889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:19.420500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:19.427883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:19.428324 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:19.429077 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:19.429535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:19.558564 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:19.566025 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9b4d6a18-cb96-4de7-9fb0-5851a6f23f92 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.150002 Jun 07 05:02:19.566609 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 487/973] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:19 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:20.054444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-e4557c21-2ef1-443d-a4e7-ac24143ebf53 req-5a253f33-6ed0-4cef-b256-ffe0c59f39d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "name": "network-vif-plugged", "status": "completed", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:02:20.063127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-e4557c21-2ef1-443d-a4e7-ac24143ebf53 req-5a253f33-6ed0-4cef-b256-ffe0c59f39d7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:20.063575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-e4557c21-2ef1-443d-a4e7-ac24143ebf53 req-5a253f33-6ed0-4cef-b256-ffe0c59f39d7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:20.075491 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-e4557c21-2ef1-443d-a4e7-ac24143ebf53 req-5a253f33-6ed0-4cef-b256-ffe0c59f39d7 service nova] Creating event network-vif-plugged:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 05:02:20.081110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-e4557c21-2ef1-443d-a4e7-ac24143ebf53 req-5a253f33-6ed0-4cef-b256-ffe0c59f39d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 Jun 07 05:02:20.081749 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 487/974] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:02:20.587025 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:20.588192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:20.595021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:20.595623 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:20.596972 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:20.597601 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:20.601567 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:20.732705 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:20.741496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-20739154-d3e0-4a6f-80d4-ebfbe3c9f36d tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.161755 Jun 07 05:02:20.742060 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 488/975] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:20 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:21.759875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:21.760570 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:21.766779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:21.767259 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:21.768096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:21.768530 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:21.898875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:21.906458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-18ff4f08-dc5e-49f8-addc-307977c561b5 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1573 microversion: 2.1 time: 0.151393 Jun 07 05:02:21.907025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 488/976] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:21 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:22.924800 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:22.925484 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:22.931558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:22.932002 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:22.932759 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:22.933184 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:23.067250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:23.074755 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c6f7fb59-df73-4b45-b8ca-2c9f7490ae80 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1560 microversion: 2.1 time: 0.154785 Jun 07 05:02:23.075322 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 489/977] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:02:22 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:52.476300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:52.477290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:52.479560 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=23 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:52.480368 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=27 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:52.486089 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.486558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.487322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.487758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.516229 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-06b0c1be-3a86-4d44-992d-8b1b0b0b764e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043850 Jun 07 05:02:52.516941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 489/978] 10.222.0.40 () {60 vars in 1342 bytes} [Tue Jun 7 05:02:52 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:02:52.576128 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:52.576656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:52.578847 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=25 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:52.579503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=10 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:02:52.586110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.586586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.587354 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.587791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.613451 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:02:52.694151 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9a68dbeb-4ea6-455a-82d2-4bb8328c6356 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 204 len: 0 microversion: 2.20 time: 0.121454 Jun 07 05:02:52.694797 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 490/979] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Jun 7 05:02:52 2022] DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 05:02:52.702879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:52.703485 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:52.709896 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.710344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.711103 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:52.711535 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:52.839628 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:52.848206 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:52.849824 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:52.851576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2d8af2cb-af73-425d-99f4-6aa4e3b677ef tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.152344 Jun 07 05:02:52.852400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 490/980] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:52 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:02:53.876085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:53.876966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:53.883657 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:53.884108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:53.884874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:53.885344 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:54.013142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:54.021644 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:54.023158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:54.024331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-88cd3ca6-0dc0-40c3-94d2-7c6ee77b778e tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1719 microversion: 2.20 time: 0.152600 Jun 07 05:02:54.024892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 491/981] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:53 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:02:55.042101 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:55.042717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:55.050490 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:55.050951 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:55.051715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:55.052175 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:55.118533 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:55.127077 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:55.129072 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54eb57ad75144537b96ca90eb4e8f778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015d0a41bd0340fcb9755a56fd7cbdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:02:55.130258 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-87f6d5d8-29ca-40d8-b0bd-6c1821c6987d tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 200 len: 1652 microversion: 2.20 time: 0.092045 Jun 07 05:02:55.130821 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 491/982] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:55 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 1652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 05:02:55.202248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-e36b8b9d-c8f1-468e-a1b9-ec8a10ca0107 req-b4177840-5ca5-4b90-a317-600cb8b07782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a141055-103a-4642-8d6f-36ad52a6133f", "name": "network-vif-deleted", "tag": "6f5a646e-5cc6-4dc5-a5ba-662e22830e90"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:02:55.213806 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e36b8b9d-c8f1-468e-a1b9-ec8a10ca0107 req-b4177840-5ca5-4b90-a317-600cb8b07782 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:55.214248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e36b8b9d-c8f1-468e-a1b9-ec8a10ca0107 req-b4177840-5ca5-4b90-a317-600cb8b07782 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:55.227074 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-e36b8b9d-c8f1-468e-a1b9-ec8a10ca0107 req-b4177840-5ca5-4b90-a317-600cb8b07782 service nova] Creating event network-vif-deleted:6f5a646e-5cc6-4dc5-a5ba-662e22830e90 for instance 5a141055-103a-4642-8d6f-36ad52a6133f on hv-cinder-83699 Jun 07 05:02:55.233561 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-e36b8b9d-c8f1-468e-a1b9-ec8a10ca0107 req-b4177840-5ca5-4b90-a317-600cb8b07782 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Jun 07 05:02:55.234480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 492/983] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:02:56.148139 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:56.149345 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:56.156010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:56.156554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:56.157294 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:56.158273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:56.174513 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f HTTP/1.1 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:02:56.176189 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:56.178163 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '5a141055-103a-4642-8d6f-36ad52a6133f'} Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:02:56.179112 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:56.180721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:56.182009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:02:56.182009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-14e6ec35-fbb4-4374-b8ec-03b69b79a1f8 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 404 len: 111 microversion: 2.20 time: 0.033522 Jun 07 05:02:56.182009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 492/984] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:56 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:02:56.188307 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5156476c-0da5-479e-ab19-3ae775727657 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '.version_select at 0x7f3d5fb631f0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:56.206382 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5156476c-0da5-479e-ab19-3ae775727657 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608580946" status: 204 len: 0 microversion: 2.20 time: 0.022804 Jun 07 05:02:56.210316 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 493/985] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Jun 7 05:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608580946 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 05:02:57.971032 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:57.971673 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:57.978113 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:57.978563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:57.979320 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:57.979756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:57.992947 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f HTTP/1.1 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:02:57.994508 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:57.996273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '5a141055-103a-4642-8d6f-36ad52a6133f'} Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:02:57.997287 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:57.998870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.000716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:02:58.000716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2c49b4d2-0b27-4aa1-988d-6879a197e2df tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 404 len: 111 microversion: 2.20 time: 0.029422 Jun 07 05:02:58.000716 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 493/986] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Jun 7 05:02:57 2022] DELETE /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:02:58.004869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:58.005632 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: 5a141055-103a-4642-8d6f-36ad52a6133f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:58.011760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:58.012211 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:58.012976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:58.013439 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:58.028793 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f HTTP/1.1 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:02:58.030424 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:58.032172 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '5a141055-103a-4642-8d6f-36ad52a6133f'} Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:02:58.033814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. Jun 07 05:02:58.035426 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:58.036895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance 5a141055-103a-4642-8d6f-36ad52a6133f could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:02:58.036895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d295ffb5-9aa7-4d2e-a04e-1428d1352da2 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f" status: 404 len: 111 microversion: 2.20 time: 0.031486 Jun 07 05:02:58.036895 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 494/987] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:57 2022] GET /compute/v2.1/servers/5a141055-103a-4642-8d6f-36ad52a6133f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 05:02:59.166949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:59.167453 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:59.174558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:59.175020 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:59.175790 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:59.176231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:59.189442 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e HTTP/1.1 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:02:59.190985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.192715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'bbb81ec9-aca6-4774-86dc-2156f21c6a6e'} Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:02:59.193758 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.195275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.196750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:02:59.196750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1fde979e-934b-4213-a8b9-361237379c54 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 404 len: 111 microversion: 2.20 time: 0.029283 Jun 07 05:02:59.196750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 494/988] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Jun 7 05:02:59 2022] DELETE /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:02:59.200616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:02:59.201282 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] [instance: bbb81ec9-aca6-4774-86dc-2156f21c6a6e] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:02:59.207898 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:59.208345 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:59.209104 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:02:59.209579 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:02:59.223252 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] HTTP exception thrown: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Request method failure captured: Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e HTTP/1.1 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintoS-im3G7OXfw6M-N-jBARAF4MRxkyMykosVr3rWYClN5W8MPWc8FNIeUM8FpAmXgY7kyfTlPndCZGK0p78trBQr_u9rDK20T-46NIyTB5bshLWuNlEsp572IryZfgrkM8avNGaRcqYLlFH_1uF3jKRiQjIm_lG4OCAgedYFAlH2R0 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:02:59.224791 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015d0a41bd0340fcb9755a56fd7cbdb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015d0a41bd0340fcb9755a56fd7cbdb9"}]}] Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 015d0a41bd0340fcb9755a56fd7cbdb9 Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1309902674 Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: 54eb57ad75144537b96ca90eb4e8f778 Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1309902674-project Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.229809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': 'bbb81ec9-aca6-4774-86dc-2156f21c6a6e'} Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:02:59.231073 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. Jun 07 05:02:59.233098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:02:59.234510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] Returning 404 to user: Instance bbb81ec9-aca6-4774-86dc-2156f21c6a6e could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:02:59.234510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ff1f3d8e-bf29-4c17-97e7-8de44a911385 tempest-AttachVolumeShelveTestJSON-1309902674 tempest-AttachVolumeShelveTestJSON-1309902674-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e" status: 404 len: 111 microversion: 2.20 time: 0.029494 Jun 07 05:02:59.234510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 495/989] 10.222.0.40 () {60 vars in 1276 bytes} [Tue Jun 7 05:02:59 2022] GET /compute/v2.1/servers/bbb81ec9-aca6-4774-86dc-2156f21c6a6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:03:07.687302 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-034366bc-17dd-48ed-bd01-ee2d757560f1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: .version_select at 0x7f3d5db360d0>, body: {"keypair": {"name": "tempest-keypair-576483232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXNTuAAWJDZSAhHoSlmWxGyIje59f27HkEW3I5siT7rw+lU/vgQeeQX9IieX/zIXAczexHpigUiAVUThXLMV9TLZCXMiJytQK9SJGaV/xKY+0zbw+9V9QeegCYyYCS0tQ=="}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:07.702540 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-034366bc-17dd-48ed-bd01-ee2d757560f1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:03:07.708161 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-034366bc-17dd-48ed-bd01-ee2d757560f1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:03:07.735949 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-034366bc-17dd-48ed-bd01-ee2d757560f1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176593 Jun 07 05:03:07.736647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 495/990] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 05:03:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:09.063879 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469402384", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae43a8ae-99bf-47b8-acdb-71f43fa74716"}], "security_groups": [{"name": "tempest-securitygroup--951489264"}], "key_name": "tempest-keypair-576483232", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:09.178839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] validate_networks() for [('ae43a8ae-99bf-47b8-acdb-71f43fa74716', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 05:03:09.215125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:09.619255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 05:03:09.620141 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 05:03:09.620970 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 05:03:09.621713 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 05:03:09.622248 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 05:03:09.632778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:09.633445 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:09.634244 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:09.634673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:09.653539 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:03:09.657542 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:03:09.670654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 05:03:09.674912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 05:03:09.733739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e728327f-13f8-4910-8f49-fad13660b231 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.674304 Jun 07 05:03:09.734387 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 496/991] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 05:03:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 05:03:09.741940 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=24 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:09.747600 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-8dbb6a93-8abc-4765-92f8-66e338e1f7ec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:09.748456 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-8dbb6a93-8abc-4765-92f8-66e338e1f7ec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:09.827971 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-8dbb6a93-8abc-4765-92f8-66e338e1f7ec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:09.836999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-8dbb6a93-8abc-4765-92f8-66e338e1f7ec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1241 microversion: 2.1 time: 0.096305 Jun 07 05:03:09.837631 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 496/992] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:09 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:10.856584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:10.857310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:10.881986 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:10.882765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:10.883761 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:10.884399 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:11.008192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:11.019584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a01f1d2a-ffad-4293-9c96-ebccec24caee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1301 microversion: 2.1 time: 0.166172 Jun 07 05:03:11.024611 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 497/993] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:10 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:12.043210 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:12.044450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:12.051906 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:12.052372 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:12.053437 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:12.053870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:12.196691 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:12.205013 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-49a0729e-cd47-4d9f-ac2a-a1a24a0feeca tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.167411 Jun 07 05:03:12.205635 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 497/994] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:12 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:12.815117 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-e2289dc0-63b9-4fd3-b427-f389eabab96f req-da658a30-8372-4333-b98b-f9ed529a3e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08", "tag": "5f6cdc74-b381-4b27-b43d-572e7af5a778"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:12.827938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e2289dc0-63b9-4fd3-b427-f389eabab96f req-da658a30-8372-4333-b98b-f9ed529a3e4f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:12.827938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-e2289dc0-63b9-4fd3-b427-f389eabab96f req-da658a30-8372-4333-b98b-f9ed529a3e4f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:12.841924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-e2289dc0-63b9-4fd3-b427-f389eabab96f req-da658a30-8372-4333-b98b-f9ed529a3e4f service nova] Creating event network-changed:5f6cdc74-b381-4b27-b43d-572e7af5a778 for instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 on hv-cinder-83699 Jun 07 05:03:12.851766 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-e2289dc0-63b9-4fd3-b427-f389eabab96f req-da658a30-8372-4333-b98b-f9ed529a3e4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040292 Jun 07 05:03:12.852687 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 498/995] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:13.221612 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:13.222381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:13.228827 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:13.229303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:13.230062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:13.230496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:13.359221 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:13.366829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c50322ae-e4ac-4d14-8f67-d94d58f47d0c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.149386 Jun 07 05:03:13.367388 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 498/996] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:13 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:14.384529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:14.385105 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:14.391292 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:14.392907 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:14.393693 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:14.394125 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:14.525250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:14.533707 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f63c094e-6964-48fc-a448-dd48312a8420 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.153739 Jun 07 05:03:14.534302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 499/997] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:14 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:15.551581 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:15.552306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:15.559326 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:15.559778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:15.560554 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:15.560992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:15.691291 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:15.698740 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a7923994-87e8-4658-9ce2-3b42605fb175 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.152030 Jun 07 05:03:15.699311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 499/998] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:15 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:16.715892 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:16.716510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:16.725450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:16.726351 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:16.727136 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:16.727569 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:16.859666 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:16.867450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-037c0d62-d9f3-41f4-a9c4-8b09603169c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.155512 Jun 07 05:03:16.868024 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 500/999] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:16 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:17.884171 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:17.884807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:17.891207 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:17.891807 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:17.892563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:17.893125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:18.021578 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:18.028927 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b7413419-485a-436c-b77f-a7613de7a27d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.148709 Jun 07 05:03:18.029523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 500/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:17 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:19.046051 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:19.046672 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:19.053395 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:19.053854 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:19.054624 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:19.055062 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:19.184508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:19.192773 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-30d1305e-dd1e-47fe-802c-5b49530d9e29 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.150572 Jun 07 05:03:19.193365 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 501/1001] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:19 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:20.210005 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:20.211394 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:20.213885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:20.218968 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:20.219467 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:20.220303 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:20.220742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:20.319883 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-94a41830-bbce-4bc6-abdb-4bece07657f9 req-3ad262d4-1128-4140-92fb-9b27e739eee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08", "name": "network-vif-plugged", "status": "completed", "tag": "5f6cdc74-b381-4b27-b43d-572e7af5a778"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:20.327503 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:20.328169 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:20.331328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-94a41830-bbce-4bc6-abdb-4bece07657f9 req-3ad262d4-1128-4140-92fb-9b27e739eee8 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:20.331989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-94a41830-bbce-4bc6-abdb-4bece07657f9 req-3ad262d4-1128-4140-92fb-9b27e739eee8 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:20.347389 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-94a41830-bbce-4bc6-abdb-4bece07657f9 req-3ad262d4-1128-4140-92fb-9b27e739eee8 service nova] Creating event network-vif-plugged:5f6cdc74-b381-4b27-b43d-572e7af5a778 for instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 on hv-cinder-83699 Jun 07 05:03:20.352732 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-94a41830-bbce-4bc6-abdb-4bece07657f9 req-3ad262d4-1128-4140-92fb-9b27e739eee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036603 Jun 07 05:03:20.354030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 502/1002] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:20.365400 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:20.373202 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4d47b475-caba-488b-97d8-6820c8f820c3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.167008 Jun 07 05:03:20.373866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 501/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:20 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 05:03:21.391952 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:21.392559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:21.398812 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:21.399257 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:21.400004 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:21.400437 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:21.530817 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:21.538721 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f41689cd-b385-4870-b909-ad3af9808ba6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1366 microversion: 2.1 time: 0.151545 Jun 07 05:03:21.539299 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 503/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:21 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:22.556549 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:22.557293 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:22.559704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:22.566481 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:22.567009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:22.567767 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:22.568195 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:22.698641 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:22.706207 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-92f708f4-257b-4d78-9f56-f2542c852d11 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1556 microversion: 2.1 time: 0.154672 Jun 07 05:03:22.707037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 502/1005] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:22 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:22.722341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:22.722958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:22.724915 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:22.730263 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:22.730719 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:22.731489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:22.731930 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:22.810471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f7d2e281-c6ef-4c2e-a05d-72cf54a43a99 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092240 Jun 07 05:03:22.811099 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 504/1006] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 05:03:22 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:23.726962 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-581e9cee-5f3d-4288-99d4-127325dfdf24 req-197cffd3-599e-4264-a33c-2d2c4e2e0fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08", "tag": "5f6cdc74-b381-4b27-b43d-572e7af5a778"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:23.736342 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-581e9cee-5f3d-4288-99d4-127325dfdf24 req-197cffd3-599e-4264-a33c-2d2c4e2e0fe8 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:23.736778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-581e9cee-5f3d-4288-99d4-127325dfdf24 req-197cffd3-599e-4264-a33c-2d2c4e2e0fe8 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:23.748124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-581e9cee-5f3d-4288-99d4-127325dfdf24 req-197cffd3-599e-4264-a33c-2d2c4e2e0fe8 service nova] Creating event network-changed:5f6cdc74-b381-4b27-b43d-572e7af5a778 for instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 on hv-cinder-83699 Jun 07 05:03:23.753196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-581e9cee-5f3d-4288-99d4-127325dfdf24 req-197cffd3-599e-4264-a33c-2d2c4e2e0fe8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030013 Jun 07 05:03:23.754092 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 503/1007] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:52.990556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=40 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:52.991295 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:52.994547 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:52.995440 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:52.995710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=38 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:03:52.995989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:53.000715 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-d9f5387d-4fac-4b6a-b655-ce8a0ab9e667 req-8c4205b6-2f0b-4c63-b01b-c3a706e5b0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:53.003280 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:53.003988 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:53.004763 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:53.005210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:53.011536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-d9f5387d-4fac-4b6a-b655-ce8a0ab9e667 req-8c4205b6-2f0b-4c63-b01b-c3a706e5b0d2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:53.012059 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-d9f5387d-4fac-4b6a-b655-ce8a0ab9e667 req-8c4205b6-2f0b-4c63-b01b-c3a706e5b0d2 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:53.023901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-d9f5387d-4fac-4b6a-b655-ce8a0ab9e667 req-8c4205b6-2f0b-4c63-b01b-c3a706e5b0d2 service nova] Creating event network-changed:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 05:03:53.030232 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-d9f5387d-4fac-4b6a-b655-ce8a0ab9e667 req-8c4205b6-2f0b-4c63-b01b-c3a706e5b0d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038516 Jun 07 05:03:53.030403 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:03:53.031223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 504/1008] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 05:03:53.126820 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a18af82c-d111-4e8b-b892-e35e50bd5863 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 204 len: 0 microversion: 2.1 time: 0.136868 Jun 07 05:03:53.128041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 505/1009] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:03:52 2022] DELETE /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:03:53.136900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:53.137632 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:53.144222 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:53.144695 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:53.145657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:53.146096 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:53.287732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:53.295459 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2f3515ea-6162-48dc-83d2-6c507627f2dc tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.162842 Jun 07 05:03:53.296036 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 505/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:53 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:54.314021 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:54.314747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:54.321154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:54.321635 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:54.322433 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:54.322867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:54.459535 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:54.467790 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-82fe9e82-315c-4478-9168-dde948ef704a tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1566 microversion: 2.1 time: 0.157942 Jun 07 05:03:54.468569 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 506/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:54 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:55.484935 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:55.485578 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:55.492033 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:55.492487 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:55.493275 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:55.493721 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:55.559498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b946c6fc174c11a1c760d6583548cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310a8a0a65f74f29aa2b004903771f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:03:55.571025 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ff361766-4f5e-405f-a5fe-3a08020c63ff tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 200 len: 1381 microversion: 2.1 time: 0.089874 Jun 07 05:03:55.571594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 506/1012] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:55 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:03:55.576286 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-3cb23735-75d6-4fa0-99d5-209edf7432c4 req-f846cb5e-7303-4c1c-bd09-259b17830c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58288984-7973-49e9-ac43-100c1b00e159", "name": "network-vif-deleted", "tag": "de942ed8-593f-4512-9e9d-c0e315e4b201"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:03:55.585412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-3cb23735-75d6-4fa0-99d5-209edf7432c4 req-f846cb5e-7303-4c1c-bd09-259b17830c25 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:55.585850 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-3cb23735-75d6-4fa0-99d5-209edf7432c4 req-f846cb5e-7303-4c1c-bd09-259b17830c25 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:55.597545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-3cb23735-75d6-4fa0-99d5-209edf7432c4 req-f846cb5e-7303-4c1c-bd09-259b17830c25 service nova] Creating event network-vif-deleted:de942ed8-593f-4512-9e9d-c0e315e4b201 for instance 58288984-7973-49e9-ac43-100c1b00e159 on hv-cinder-83699 Jun 07 05:03:55.602315 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-3cb23735-75d6-4fa0-99d5-209edf7432c4 req-f846cb5e-7303-4c1c-bd09-259b17830c25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030662 Jun 07 05:03:55.602920 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 507/1013] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:03:56.576142 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:03:56.576719 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:03:56.587569 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:56.588174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] [instance: 58288984-7973-49e9-ac43-100c1b00e159] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:03:56.594975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:56.595608 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:56.596369 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:03:56.596801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:03:56.609668 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] HTTP exception thrown: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Request method failure captured: Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 HTTP/1.1 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintsDA0ypGtCEHilVLKTplTqdi_KE2NlfYFqbRmZ8707bO2NG75QoUFvRKrRIuIgm1Ek_avbqIIsMJM8sYjODbZSUYuf35PSFitdo_oHrtazVn9lFKN0JEh0xcbhHS0PW7Rz91pzrGibzD5lHdDraod0pxmWtqWukCXnLph8g0QIgTxE Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 310a8a0a65f74f29aa2b004903771f89 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-TestShelveInstance-582884595 Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:03:56.612002 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/310a8a0a65f74f29aa2b004903771f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/310a8a0a65f74f29aa2b004903771f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_310a8a0a65f74f29aa2b004903771f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/310a8a0a65f74f29aa2b004903771f89"}]}] Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-TestShelveInstance-582884595 Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 310a8a0a65f74f29aa2b004903771f89 Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-TestShelveInstance-582884595 Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-TestShelveInstance-582884595-project Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: 23b946c6fc174c11a1c760d6583548cb Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-TestShelveInstance-582884595-project Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. Jun 07 05:03:56.613851 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '58288984-7973-49e9-ac43-100c1b00e159'} Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:03:56.614746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. Jun 07 05:03:56.616144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:03:56.617441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Returning 404 to user: Instance 58288984-7973-49e9-ac43-100c1b00e159 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:03:56.617441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-af6033ee-fb92-4f09-b52d-1428bf20180f tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159" status: 404 len: 111 microversion: 2.1 time: 0.029480 Jun 07 05:03:56.617441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 507/1014] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:03:56 2022] GET /compute/v2.1/servers/58288984-7973-49e9-ac43-100c1b00e159 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:03:56.793485 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f9ab4ca6-6f16-4c39-b176-bc07530ede21 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] Calling method '.version_select at 0x7f3d5daa31f0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:03:56.810889 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f9ab4ca6-6f16-4c39-b176-bc07530ede21 tempest-TestShelveInstance-582884595 tempest-TestShelveInstance-582884595-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-943579736" status: 202 len: 0 microversion: 2.1 time: 0.022064 Jun 07 05:03:56.811471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 508/1015] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-943579736 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:04:28.520800 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:28.521391 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:28.523339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=8 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:28.524125 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=16 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:28.530398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:28.530856 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:28.531624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:28.532067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:28.555283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-1bc93916-fd27-4799-bc15-e3a6d57a0a3a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/ips" status: 200 len: 149 microversion: 2.1 time: 0.038795 Jun 07 05:04:28.556048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 508/1016] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:04:28 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:04:30.094419 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:30.095190 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:30.100023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e740b9b2-acff-47d8-899e-e5bfd0ca50b6"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:30.101160 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:30.109967 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:30.110560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:30.111181 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:30.111618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:30.365928 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-dce89902-27f9-4320-b54d-9368edda8df6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272786 Jun 07 05:04:30.366857 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 509/1017] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 05:04:30 2022] POST /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:04:37.854328 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cc3a609f-229f-4799-8138-87c3fb2f4998 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: .version_select at 0x7f3d5dc2cee0>, body: {"keypair": {"name": "tempest-keypair-398100664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8DrCm19TNdxQCfvB/DCqKo+Eq9NNweHrhZmWkCf3jBHcdwKB492PjijaDmGmABCmcojW4sOU+RRuhzXy8wyRW+/MG2SDIH4Ud/h0DK0nue7miHN88aSsfwsC8BvHrvUg=="}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:37.869077 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-cc3a609f-229f-4799-8138-87c3fb2f4998 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:04:37.872828 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-cc3a609f-229f-4799-8138-87c3fb2f4998 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:04:37.895100 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cc3a609f-229f-4799-8138-87c3fb2f4998 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044660 Jun 07 05:04:37.895683 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 509/1018] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 05:04:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 05:04:39.212423 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-650332603", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae43a8ae-99bf-47b8-acdb-71f43fa74716"}], "security_groups": [{"name": "tempest-securitygroup--1230630419"}], "key_name": "tempest-keypair-398100664", "user_data": "}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:39.320339 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.network.neutron [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] validate_networks() for [('ae43a8ae-99bf-47b8-acdb-71f43fa74716', None, None, None, None, None)] {{(pid=124421) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 05:04:39.684235 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 05:04:39.684663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image limits 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 05:04:39.685135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 05:04:39.685566 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image pref 0:0:0 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 05:04:39.685978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.virt.hardware [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 05:04:39.695463 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:39.695912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:39.696711 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:39.697142 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:39.714052 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:04:39.718018 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:04:39.728887 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Going to run 1 instances... {{(pid=124421) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 05:04:39.731267 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 05:04:39.778756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-af713b09-2f78-4d4b-8e94-c27e31b7c42e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570891 Jun 07 05:04:39.779398 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 510/1019] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 05:04:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 05:04:39.789793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ab38167a-b795-4b5b-b964-d5afff1006c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:39.790406 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ab38167a-b795-4b5b-b964-d5afff1006c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:39.792281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=4 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:39.846675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ab38167a-b795-4b5b-b964-d5afff1006c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:39.856336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ab38167a-b795-4b5b-b964-d5afff1006c8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1240 microversion: 2.1 time: 0.070296 Jun 07 05:04:39.856988 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 510/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:39 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 05:04:40.874658 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:40.875283 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:40.883643 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:40.884095 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:40.884880 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:40.885348 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:40.947552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:40.955159 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-82b19a9f-be89-4c76-ac6c-aef68ea8ef46 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1310 microversion: 2.1 time: 0.084913 Jun 07 05:04:40.955717 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 511/1021] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:40 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:41.973680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:41.974279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:41.980901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:41.981381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:41.982144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:41.982575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:42.120336 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:42.128923 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-19fee13e-f7bb-40b3-9a55-43e92bfe5593 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.159684 Jun 07 05:04:42.129696 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 511/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:41 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:42.477776 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-c349f5d0-46ea-48ed-b89a-25ee2e15f0b7 req-47f1292a-470f-4fa2-b062-36262e4640bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4f287-a21c-4d24-841b-90f6245fbb55", "tag": "1d40d878-1b26-46cd-bcf9-34b94ffa26ec"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:42.486416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c349f5d0-46ea-48ed-b89a-25ee2e15f0b7 req-47f1292a-470f-4fa2-b062-36262e4640bb service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:42.486864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-c349f5d0-46ea-48ed-b89a-25ee2e15f0b7 req-47f1292a-470f-4fa2-b062-36262e4640bb service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:42.498639 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-c349f5d0-46ea-48ed-b89a-25ee2e15f0b7 req-47f1292a-470f-4fa2-b062-36262e4640bb service nova] Creating event network-changed:1d40d878-1b26-46cd-bcf9-34b94ffa26ec for instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 on hv-cinder-83699 Jun 07 05:04:42.505139 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-c349f5d0-46ea-48ed-b89a-25ee2e15f0b7 req-47f1292a-470f-4fa2-b062-36262e4640bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179755 Jun 07 05:04:42.506441 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 512/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:04:43.146276 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:43.147172 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:43.153866 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:43.154311 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:43.155074 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:43.155504 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:43.286127 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:43.293796 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-f51cad16-45cb-4f6f-bf22-84ba65483bc3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.151565 Jun 07 05:04:43.294364 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 512/1024] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:43 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:44.311971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:44.312668 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:44.318981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:44.319431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:44.320199 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:44.320638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:44.446987 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:44.454386 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-166b47ae-828d-4189-8c78-0afa0b345b0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.147110 Jun 07 05:04:44.454962 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 513/1025] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:44 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:45.471191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:45.471839 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:45.478300 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:45.478751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:45.479512 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:45.479945 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:45.615611 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:45.622930 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ef9ecb6c-b81a-4d53-94b3-58228577c763 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.155666 Jun 07 05:04:45.623484 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 513/1026] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:45 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:46.639923 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:46.640543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:46.647614 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:46.648075 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:46.648837 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:46.649297 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:46.780328 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:46.788630 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a9007111-47ec-4d5d-8b98-4e7bd2d5c779 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.152631 Jun 07 05:04:46.789192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 514/1027] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:46 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:47.805301 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:47.805916 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:47.812642 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:47.813087 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:47.813875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:47.814310 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:47.946156 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:47.953640 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-02b52adb-ee63-4984-8087-af9704d70799 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.152129 Jun 07 05:04:47.954210 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 514/1028] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:47 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:48.787981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-54c6e096-c73f-4d53-807d-e37b10f88f11 req-91124785-0a25-4758-8dd2-ed73fecb45c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa4f287-a21c-4d24-841b-90f6245fbb55", "name": "network-vif-plugged", "status": "completed", "tag": "1d40d878-1b26-46cd-bcf9-34b94ffa26ec"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:48.797210 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-54c6e096-c73f-4d53-807d-e37b10f88f11 req-91124785-0a25-4758-8dd2-ed73fecb45c0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:48.797709 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-54c6e096-c73f-4d53-807d-e37b10f88f11 req-91124785-0a25-4758-8dd2-ed73fecb45c0 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:48.808537 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-54c6e096-c73f-4d53-807d-e37b10f88f11 req-91124785-0a25-4758-8dd2-ed73fecb45c0 service nova] Creating event network-vif-plugged:1d40d878-1b26-46cd-bcf9-34b94ffa26ec for instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 on hv-cinder-83699 Jun 07 05:04:48.813659 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-54c6e096-c73f-4d53-807d-e37b10f88f11 req-91124785-0a25-4758-8dd2-ed73fecb45c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089337 Jun 07 05:04:48.814236 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 515/1029] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 05:04:48.970618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:48.971227 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:48.978393 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:48.978844 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:48.979660 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:48.980083 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:49.108615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:49.116212 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a27f0495-e76d-4721-8c28-2e7d18cb835d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.149659 Jun 07 05:04:49.116783 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 515/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:48 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:50.133552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:50.134246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:50.136166 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:50.136809 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:50.144085 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:50.144533 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:50.145305 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:50.145729 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:50.274756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:50.282250 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-72c992aa-36da-43e4-bba0-185605555497 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1366 microversion: 2.1 time: 0.153312 Jun 07 05:04:50.282824 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 516/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:50 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:51.298877 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:51.300011 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:51.301985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:04:51.307644 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:51.308098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:51.308861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:51.309322 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:51.441594 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:04:51.448954 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7d8ad48a-66ad-4347-9549-0ef8d18f0418 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1557 microversion: 2.1 time: 0.153941 Jun 07 05:04:51.449553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 516/1032] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:04:51 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:04:51.464550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:04:51.465048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:04:51.471915 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:51.472368 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:51.473158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:51.473619 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:51.550655 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c2364209-ad62-47a0-ba58-6ebc3973a2b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089759 Jun 07 05:04:51.551525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 517/1033] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 05:04:51 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:04:52.745164 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-fd9472f7-7c6d-4669-a87f-f7d2a3f0ea2a req-e73cf7d4-1305-4993-9060-2beba12dbaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4f287-a21c-4d24-841b-90f6245fbb55", "tag": "1d40d878-1b26-46cd-bcf9-34b94ffa26ec"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:04:52.753558 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-fd9472f7-7c6d-4669-a87f-f7d2a3f0ea2a req-e73cf7d4-1305-4993-9060-2beba12dbaea service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:04:52.754261 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-fd9472f7-7c6d-4669-a87f-f7d2a3f0ea2a req-e73cf7d4-1305-4993-9060-2beba12dbaea service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:04:52.766605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-fd9472f7-7c6d-4669-a87f-f7d2a3f0ea2a req-e73cf7d4-1305-4993-9060-2beba12dbaea service nova] Creating event network-changed:1d40d878-1b26-46cd-bcf9-34b94ffa26ec for instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 on hv-cinder-83699 Jun 07 05:04:52.772482 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-fd9472f7-7c6d-4669-a87f-f7d2a3f0ea2a req-e73cf7d4-1305-4993-9060-2beba12dbaea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088832 Jun 07 05:04:52.773686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 517/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:08.077989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:08.078754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:08.083626 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:08.084112 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:08.092760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.093287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.094041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.094471 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.121072 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0d2dba0c-091c-4801-a2ba-038baf49c935 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/ips" status: 200 len: 151 microversion: 2.1 time: 0.045146 Jun 07 05:06:08.121659 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 518/1035] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:06:08 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:08.130426 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:08.131165 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=38 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:08.135793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e740b9b2-acff-47d8-899e-e5bfd0ca50b6"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:08.136935 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:08.144051 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.144499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.145281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.145724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.224370 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: POST /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/os-volume_attachments HTTP/1.1 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 74 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:06:08.227272 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {"volumeAttachment": {"volumeId": "e740b9b2-acff-47d8-899e-e5bfd0ca50b6"}} Jun 07 05:06:08.229095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'server_id': '6fa4f287-a21c-4d24-841b-90f6245fbb55', 'body': {'volumeAttachment': {'volumeId': 'e740b9b2-acff-47d8-899e-e5bfd0ca50b6'}}} Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:08.230035 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:08.231475 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 400 to user: Invalid volume: volume e740b9b2-acff-47d8-899e-e5bfd0ca50b6 is already attached to instances: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-91ed516e-6d65-4b72-86a3-c7fb11a49be8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100549 Jun 07 05:06:08.233359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 518/1036] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 05:06:08 2022] POST /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:06:08.237415 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:08.237939 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:08.244259 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.244710 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.245501 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.245939 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.270101 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:06:08.344014 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-16afc7c9-947b-42c9-9c14-6629469af91f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 204 len: 0 microversion: 2.1 time: 0.110132 Jun 07 05:06:08.344514 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 519/1037] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:06:08 2022] DELETE /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 05:06:08.353427 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:08.354041 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:08.360637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.361082 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.361863 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:08.362290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:08.491605 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:08.499199 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-415ebbae-4abd-4548-a48f-6dc30dce8070 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1682 microversion: 2.1 time: 0.150445 Jun 07 05:06:08.499762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 519/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:08 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:09.517510 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:09.518215 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:09.524891 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:09.525377 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:09.526143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:09.526578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:09.658270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:09.666947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-455d3fbd-6c3d-4d41-8445-87e90f4d4103 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1682 microversion: 2.1 time: 0.153648 Jun 07 05:06:09.667512 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 520/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:09 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:10.687160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:10.687160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:10.693169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:10.693640 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:10.695197 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:10.695873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:10.760314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:10.767843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-52b0e273-059d-4680-bc1e-bd3023c1ea3f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 200 len: 1614 microversion: 2.1 time: 0.086915 Jun 07 05:06:10.768624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 520/1040] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:10 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:10.792654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-57756b2c-6cd1-4b7e-b988-3770d5750083 req-4f7b9105-997e-40dd-86e3-e2e1445b91ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa4f287-a21c-4d24-841b-90f6245fbb55", "name": "network-vif-deleted", "tag": "1d40d878-1b26-46cd-bcf9-34b94ffa26ec"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:10.801941 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-57756b2c-6cd1-4b7e-b988-3770d5750083 req-4f7b9105-997e-40dd-86e3-e2e1445b91ec service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:10.802442 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-57756b2c-6cd1-4b7e-b988-3770d5750083 req-4f7b9105-997e-40dd-86e3-e2e1445b91ec service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:10.814185 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-57756b2c-6cd1-4b7e-b988-3770d5750083 req-4f7b9105-997e-40dd-86e3-e2e1445b91ec service nova] Creating event network-vif-deleted:1d40d878-1b26-46cd-bcf9-34b94ffa26ec for instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 on hv-cinder-83699 Jun 07 05:06:10.818863 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-57756b2c-6cd1-4b7e-b988-3770d5750083 req-4f7b9105-997e-40dd-86e3-e2e1445b91ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Jun 07 05:06:10.819723 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 521/1041] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:11.785325 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:11.785861 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:11.792904 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:11.793392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:11.794925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:11.795573 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:11.814975 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 HTTP/1.1 Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:06:11.816518 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:06:11.818196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '6fa4f287-a21c-4d24-841b-90f6245fbb55'} Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:06:11.819686 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:06:11.821098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:06:11.822421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:06:11.822421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-80417ff6-aa8e-40f4-9fb0-2441bd127f8c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 404 len: 111 microversion: 2.1 time: 0.036616 Jun 07 05:06:11.822421 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 521/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:11 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:06:11.828599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a1b6bbb5-ae0a-43e4-aff7-0e28852a908f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '.version_select at 0x7f3d5da97820>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:11.831760 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a1b6bbb5-ae0a-43e4-aff7-0e28852a908f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [c0af290c-0c84-4396-b125-e7782cdb8992] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 05:06:12.838984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [None req-a1b6bbb5-ae0a-43e4-aff7-0e28852a908f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [c0af290c-0c84-4396-b125-e7782cdb8992] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 55096. Jun 07 05:06:12.858116 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a1b6bbb5-ae0a-43e4-aff7-0e28852a908f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398100664" status: 202 len: 0 microversion: 2.1 time: 1.034064 Jun 07 05:06:12.858680 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 522/1043] 10.222.0.40 () {58 vars in 1217 bytes} [Tue Jun 7 05:06:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398100664 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:06:13.520129 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:13.520648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:13.527622 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:13.528062 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:13.528814 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:13.529269 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:13.607648 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lazy-loading 'services' on Instance uuid 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:06:13.680053 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-73ac489c-53cf-446e-a7b5-11131e1d7331 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments/e740b9b2-acff-47d8-899e-e5bfd0ca50b6" status: 202 len: 0 microversion: 2.1 time: 0.163520 Jun 07 05:06:13.680654 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 522/1044] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 05:06:13 2022] DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments/e740b9b2-acff-47d8-899e-e5bfd0ca50b6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:06:13.688949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:13.690031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:13.697356 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:13.697808 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:13.698583 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:13.699020 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:13.728715 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-603b0ea8-64f2-407d-99b5-22e7990936b2 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Jun 07 05:06:13.729191 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 523/1045] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:06:13 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:14.741724 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:14.742794 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:14.748972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.749451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:14.750209 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.750639 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:14.779039 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-066a81a7-8072-4bc8-9fc1-a06f87963a96 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042635 Jun 07 05:06:14.779598 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 523/1046] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:06:14 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 05:06:14.836975 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:14.837486 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:14.843853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.844304 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:14.845069 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.845531 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:14.870449 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Going to try to terminate instance {{(pid=124421) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:06:14.947921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-808c67c7-d1b2-4a07-b260-f0eb62481f16 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 204 len: 0 microversion: 2.1 time: 0.115211 Jun 07 05:06:14.948704 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 524/1047] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:06:14 2022] DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:06:14.958515 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:14.959133 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:14.965404 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.965860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:14.966619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:14.967055 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:15.099235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:15.106892 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b176e0e1-ea73-413d-8f27-1b3abe4b701a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1680 microversion: 2.1 time: 0.153910 Jun 07 05:06:15.107458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 524/1048] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:14 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:16.125083 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:16.125813 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:16.133326 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:16.133778 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:16.134543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:16.134976 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:16.265899 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:16.274159 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-edb4bd48-5ee3-45d8-b5c9-286cc427c0f0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1680 microversion: 2.1 time: 0.153302 Jun 07 05:06:16.274754 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 525/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:16 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:17.293153 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:17.294028 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:17.301901 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:17.302356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:17.303647 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:17.304093 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:17.448911 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:17.456867 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c6f6f238-2f69-4a2b-8030-2dd47e56a925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1680 microversion: 2.1 time: 0.169082 Jun 07 05:06:17.467587 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 525/1050] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:17 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:18.012603 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-336d9de1-f8eb-4b13-939a-7a3f080a37fa req-0c3c3ed0-fd66-4d6f-ae4e-603a13aa3158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08", "name": "network-vif-deleted", "tag": "5f6cdc74-b381-4b27-b43d-572e7af5a778"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:18.024839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-336d9de1-f8eb-4b13-939a-7a3f080a37fa req-0c3c3ed0-fd66-4d6f-ae4e-603a13aa3158 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:18.026030 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-336d9de1-f8eb-4b13-939a-7a3f080a37fa req-0c3c3ed0-fd66-4d6f-ae4e-603a13aa3158 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:18.041934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-336d9de1-f8eb-4b13-939a-7a3f080a37fa req-0c3c3ed0-fd66-4d6f-ae4e-603a13aa3158 service nova] Creating event network-vif-deleted:5f6cdc74-b381-4b27-b43d-572e7af5a778 for instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 on hv-cinder-83699 Jun 07 05:06:18.047481 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-336d9de1-f8eb-4b13-939a-7a3f080a37fa req-0c3c3ed0-fd66-4d6f-ae4e-603a13aa3158 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038437 Jun 07 05:06:18.048551 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 526/1051] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:18.474869 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:18.475494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:18.483344 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:18.483960 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:18.484749 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:18.485191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:18.520000 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:18.520458 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:18.520919 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.objects.instance [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lazy-loading 'fault' on Instance uuid 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 {{(pid=124422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:06:18.570746 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:18.577775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-2dcb4833-97d1-4f97-ba85-d70af72b2d6f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 200 len: 1331 microversion: 2.1 time: 0.107012 Jun 07 05:06:18.578340 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 526/1052] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:18 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:19.595618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:19.596314 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:19.603513 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:19.603954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:19.604706 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:19.605135 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:19.618506 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 HTTP/1.1 Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:06:19.620090 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:06:19.621832 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08'} Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:06:19.623529 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:06:19.625182 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:06:19.626629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:06:19.626629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f5deed8d-461d-4aff-a3db-81f68743537c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 404 len: 111 microversion: 2.1 time: 0.030020 Jun 07 05:06:19.626629 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 527/1053] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:19 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:06:19.630329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d2a3792a-1c44-45dc-b9f9-d5d1ca358464 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '.version_select at 0x7f3d5db14ca0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:19.648998 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d2a3792a-1c44-45dc-b9f9-d5d1ca358464 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576483232" status: 202 len: 0 microversion: 2.1 time: 0.022716 Jun 07 05:06:19.649615 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 527/1054] 10.222.0.40 () {58 vars in 1217 bytes} [Tue Jun 7 05:06:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576483232 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:06:20.267559 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a14e501f-0a89-4410-a053-8101daab7ab6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: .version_select at 0x7f3d5daa3280>, body: {"keypair": {"name": "tempest-keypair-1323808124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4o9vpU+FdnoVkTeQajZbFj9tGQeNahpwBcH8iqL5BlH14A5Bm4W0QWGbUmMZO11KNTfPH/XE0+JUhr7iKnia1YRlId+o7Vbvv3ThZdCXQWggvasaTodhzgYhq5VuXvKw=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:20.281821 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-a14e501f-0a89-4410-a053-8101daab7ab6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:06:20.285556 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-a14e501f-0a89-4410-a053-8101daab7ab6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:06:20.307197 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a14e501f-0a89-4410-a053-8101daab7ab6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043460 Jun 07 05:06:20.307774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 528/1055] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 05:06:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:21.531684 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2013595288", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae43a8ae-99bf-47b8-acdb-71f43fa74716"}], "security_groups": [{"name": "tempest-securitygroup--849509644"}], "key_name": "tempest-keypair-1323808124", "user_data": "}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:21.633162 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] validate_networks() for [('ae43a8ae-99bf-47b8-acdb-71f43fa74716', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 05:06:22.087359 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 05:06:22.087783 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 05:06:22.088256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 05:06:22.088693 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 05:06:22.089104 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 05:06:22.097834 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:22.098281 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:22.099069 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:22.099501 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:22.116761 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:06:22.120711 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:06:22.131829 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 05:06:22.134088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 05:06:22.187289 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-6d645d7e-0e9d-48fa-ac60-beb12ecd5485 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.660290 Jun 07 05:06:22.187928 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 528/1056] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 05:06:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 05:06:22.198247 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0b2533de-d631-4b2e-97c5-519e13778979 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:22.198864 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0b2533de-d631-4b2e-97c5-519e13778979 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:22.257416 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0b2533de-d631-4b2e-97c5-519e13778979 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:22.264420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0b2533de-d631-4b2e-97c5-519e13778979 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1242 microversion: 2.1 time: 0.070376 Jun 07 05:06:22.264867 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 529/1057] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:22 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:23.282270 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:23.282925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:23.289782 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:23.290235 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:23.291006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:23.291449 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:23.350244 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:23.357576 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-64412a7e-8102-4222-9ab7-2cbffe5844ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1300 microversion: 2.1 time: 0.079617 Jun 07 05:06:23.358160 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 529/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:23 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:24.375155 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:24.375875 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:24.383483 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:24.384412 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:24.385765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:24.386448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:24.528154 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:24.535906 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9c58799c-2a1a-4beb-b364-f5997407a95a tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.164565 Jun 07 05:06:24.536488 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 530/1059] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:24 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:24.578120 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-9341aad0-aef3-4431-ad79-5f6317e5c35d req-432f25c1-2527-42c8-b3f9-0a3cb0bb86ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06150f1f-862a-46ba-9d06-ed8aceb7c462", "tag": "c41b4a3b-4c55-4814-bdd7-34c77c41c248"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:24.589731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-9341aad0-aef3-4431-ad79-5f6317e5c35d req-432f25c1-2527-42c8-b3f9-0a3cb0bb86ab service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:24.590570 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-9341aad0-aef3-4431-ad79-5f6317e5c35d req-432f25c1-2527-42c8-b3f9-0a3cb0bb86ab service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:24.605619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-9341aad0-aef3-4431-ad79-5f6317e5c35d req-432f25c1-2527-42c8-b3f9-0a3cb0bb86ab service nova] Creating event network-changed:c41b4a3b-4c55-4814-bdd7-34c77c41c248 for instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 on hv-cinder-83699 Jun 07 05:06:24.611659 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-9341aad0-aef3-4431-ad79-5f6317e5c35d req-432f25c1-2527-42c8-b3f9-0a3cb0bb86ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Jun 07 05:06:24.612279 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 530/1060] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:25.552350 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:25.553495 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:25.560044 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:25.560491 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:25.561271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:25.561708 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:25.695787 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:25.703207 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1e88c52e-a79a-4163-a68b-d92513bf9d15 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.154683 Jun 07 05:06:25.703942 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 531/1061] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:25 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:26.719973 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:26.720702 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:26.727552 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:26.728011 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:26.728809 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:26.729273 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:26.857398 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:26.864801 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-ca4b2657-1fee-4b14-b961-3b4bcb617d12 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.149545 Jun 07 05:06:26.865399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 531/1062] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:26 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:27.882496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:27.883108 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:27.889585 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:27.890031 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:27.890789 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:27.891226 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:28.025971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:28.033301 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e93b2d52-aebb-4b49-8f41-a10c40daba07 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.155711 Jun 07 05:06:28.033870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 532/1063] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:27 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:29.049972 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:29.050588 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:29.058227 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:29.058676 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:29.059441 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:29.059875 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:29.192617 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:29.200304 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-188196ff-0ef0-44d0-b191-96163a366fb7 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.154132 Jun 07 05:06:29.200876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 532/1064] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:29 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:30.217927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:30.218547 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:30.225702 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:30.226158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:30.226954 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:30.227394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:30.355881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:30.363107 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-b2e34145-88fb-4dd8-9f03-dee4d978a433 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.149094 Jun 07 05:06:30.363678 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 533/1065] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:30 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:31.236137 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-a6d2de3e-4635-495f-a31a-a7917471e060 req-6ff44136-6b61-4772-bfc5-6a74a0f1402f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06150f1f-862a-46ba-9d06-ed8aceb7c462", "name": "network-vif-plugged", "status": "completed", "tag": "c41b4a3b-4c55-4814-bdd7-34c77c41c248"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:31.246494 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-a6d2de3e-4635-495f-a31a-a7917471e060 req-6ff44136-6b61-4772-bfc5-6a74a0f1402f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:31.246961 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-a6d2de3e-4635-495f-a31a-a7917471e060 req-6ff44136-6b61-4772-bfc5-6a74a0f1402f service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:31.259701 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-a6d2de3e-4635-495f-a31a-a7917471e060 req-6ff44136-6b61-4772-bfc5-6a74a0f1402f service nova] Creating event network-vif-plugged:c41b4a3b-4c55-4814-bdd7-34c77c41c248 for instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 on hv-cinder-83699 Jun 07 05:06:31.264890 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-a6d2de3e-4635-495f-a31a-a7917471e060 req-6ff44136-6b61-4772-bfc5-6a74a0f1402f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Jun 07 05:06:31.265713 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 533/1066] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:31.380243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:31.381682 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:31.389478 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:31.389881 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:31.390656 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:31.391080 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:31.527664 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:31.535019 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-9119eb4e-783a-4664-aa19-69123dbde95c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.159003 Jun 07 05:06:31.535587 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 534/1067] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:31 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:32.551582 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:32.552334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:32.554381 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:32.555145 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:32.561392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:32.561843 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:32.562606 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:32.563040 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:32.702451 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:32.709882 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d76b1ca3-d8aa-4584-86e9-bf314a45b02b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1367 microversion: 2.1 time: 0.162487 Jun 07 05:06:32.711430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 534/1068] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:32 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:33.727177 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:33.727814 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:33.729798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:06:33.735598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:33.736041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:33.736799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:33.737246 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:33.867074 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:06:33.874528 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-49f56975-d7e0-40fb-a840-31020cf1d2db tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1557 microversion: 2.1 time: 0.152058 Jun 07 05:06:33.875093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 535/1069] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:06:33 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:06:33.891536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:06:33.892078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:06:33.899278 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:33.899728 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:33.900488 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:33.900925 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:33.976173 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-cba3b4db-327b-41d3-86f7-af487e9267fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088476 Jun 07 05:06:33.976779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 535/1070] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 05:06:33 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:06:35.129922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [req-00b30e47-827b-404a-8fe6-5517caff5d4a req-0263222f-bc65-4b79-bde7-9cdb20f94cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06150f1f-862a-46ba-9d06-ed8aceb7c462", "tag": "c41b4a3b-4c55-4814-bdd7-34c77c41c248"}]} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:06:35.138616 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-00b30e47-827b-404a-8fe6-5517caff5d4a req-0263222f-bc65-4b79-bde7-9cdb20f94cc6 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:06:35.139056 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [req-00b30e47-827b-404a-8fe6-5517caff5d4a req-0263222f-bc65-4b79-bde7-9cdb20f94cc6 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:06:35.149649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.compute.server_external_events [req-00b30e47-827b-404a-8fe6-5517caff5d4a req-0263222f-bc65-4b79-bde7-9cdb20f94cc6 service nova] Creating event network-changed:c41b4a3b-4c55-4814-bdd7-34c77c41c248 for instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 on hv-cinder-83699 Jun 07 05:06:35.154560 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [req-00b30e47-827b-404a-8fe6-5517caff5d4a req-0263222f-bc65-4b79-bde7-9cdb20f94cc6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028468 Jun 07 05:06:35.155127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 536/1071] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:07:03.615208 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:07:03.615950 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:07:43.781376 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:07:43.782122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:07:43.786695 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:43.787191 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:43.795979 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:43.796430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:43.797195 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:43.797657 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:43.824731 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e1ec76fd-f69f-4a52-b92f-ac9961e9bef0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/ips" status: 200 len: 149 microversion: 2.1 time: 0.045221 Jun 07 05:07:43.825329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 536/1072] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:07:43 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:07:45.136866 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:07:45.137638 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:07:45.142145 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc74e6f-994a-4b13-b213-471ff4b3bb16"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:07:45.143289 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:45.151319 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:45.151772 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:45.152539 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:45.152978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:45.517270 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5e059222-0297-40b2-b4c0-ea6178c2cb44 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382181 Jun 07 05:07:45.517964 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 537/1073] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 05:07:45 2022] POST /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:07:52.998879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc74e6f-994a-4b13-b213-471ff4b3bb16"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:07:52.999941 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:53.006545 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.006992 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.007745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.008245 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.137587 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: POST /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments HTTP/1.1 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 74 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:07:53.139405 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {"volumeAttachment": {"volumeId": "7cc74e6f-994a-4b13-b213-471ff4b3bb16"}} Jun 07 05:07:53.141095 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'server_id': '06150f1f-862a-46ba-9d06-ed8aceb7c462', 'body': {'volumeAttachment': {'volumeId': '7cc74e6f-994a-4b13-b213-471ff4b3bb16'}}} Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:07:53.141994 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:53.143315 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 400 to user: Invalid volume: volume 7cc74e6f-994a-4b13-b213-471ff4b3bb16 is already attached to instances: 06150f1f-862a-46ba-9d06-ed8aceb7c462 {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-da483024-e66e-43fd-9923-c61411cf3c39 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145927 Jun 07 05:07:53.145131 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 537/1074] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 05:07:52 2022] POST /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 05:07:53.200870 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:53.201458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:53.207557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.208011 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.208771 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.209204 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.288816 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lazy-loading 'services' on Instance uuid 06150f1f-862a-46ba-9d06-ed8aceb7c462 {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:07:53.360921 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a6550339-bc65-4bba-a2f4-98464e103b7c tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments/7cc74e6f-994a-4b13-b213-471ff4b3bb16" status: 202 len: 0 microversion: 2.1 time: 0.164694 Jun 07 05:07:53.361543 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 538/1075] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 05:07:53 2022] DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments/7cc74e6f-994a-4b13-b213-471ff4b3bb16 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:07:53.370652 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:53.371665 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:53.377736 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.378283 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.379312 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:53.379751 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:53.410064 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7ff7c9fa-0c30-445e-b0f1-de7960e3f6f8 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Jun 07 05:07:53.410619 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 538/1076] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:07:53 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:07:54.422447 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:54.423508 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:54.431342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.431792 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.432550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.432978 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.461819 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3aebe033-8840-4c0d-9351-aa024528d791 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043187 Jun 07 05:07:54.462370 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 539/1077] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:07:54 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 05:07:54.518876 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:54.519389 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:54.526496 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.526948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.527707 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.528142 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.553110 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:07:54.627756 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-4df67668-7cb1-4c3b-9c58-e43e5610c0fd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 204 len: 0 microversion: 2.1 time: 0.112404 Jun 07 05:07:54.628339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 539/1078] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:07:54 2022] DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:07:54.636663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:54.637303 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:54.643218 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.643691 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.644430 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:54.644866 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:54.777726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:07:54.785067 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-94fe9b49-1b94-4ee4-92c0-4179a98ff350 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1681 microversion: 2.1 time: 0.152309 Jun 07 05:07:54.785674 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 540/1079] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:07:54 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:07:55.802791 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:55.803498 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:55.810730 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:55.811184 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:55.811946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:55.812382 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:55.943908 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:07:55.951536 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c242b8fd-e218-4fac-a11e-751de0cb7bfa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1681 microversion: 2.1 time: 0.153006 Jun 07 05:07:55.952098 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 540/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:07:55 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:07:56.968134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:56.968747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:56.975604 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:56.976061 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:56.976905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:56.977496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:57.044183 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:07:57.051829 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-96ba903d-ea31-4c72-a882-745779908fd1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 200 len: 1614 microversion: 2.1 time: 0.087485 Jun 07 05:07:57.052525 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 541/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:07:56 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:07:57.282769 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-49d14533-fe69-44ff-a3b0-28c11ef3e88d req-fa135a1b-7bbc-4245-94e9-a380c6fc9f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06150f1f-862a-46ba-9d06-ed8aceb7c462", "name": "network-vif-deleted", "tag": "c41b4a3b-4c55-4814-bdd7-34c77c41c248"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:07:57.293689 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-49d14533-fe69-44ff-a3b0-28c11ef3e88d req-fa135a1b-7bbc-4245-94e9-a380c6fc9f0c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:57.294054 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-49d14533-fe69-44ff-a3b0-28c11ef3e88d req-fa135a1b-7bbc-4245-94e9-a380c6fc9f0c service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:57.306392 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-49d14533-fe69-44ff-a3b0-28c11ef3e88d req-fa135a1b-7bbc-4245-94e9-a380c6fc9f0c service nova] Creating event network-vif-deleted:c41b4a3b-4c55-4814-bdd7-34c77c41c248 for instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 on hv-cinder-83699 Jun 07 05:07:57.312174 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-49d14533-fe69-44ff-a3b0-28c11ef3e88d req-fa135a1b-7bbc-4245-94e9-a380c6fc9f0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Jun 07 05:07:57.313604 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 541/1082] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:07:58.069550 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:58.070170 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:07:58.078192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:58.078820 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:58.079621 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:07:58.080065 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:07:58.095310 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 HTTP/1.1 Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:07:58.096974 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:07:58.098648 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '06150f1f-862a-46ba-9d06-ed8aceb7c462'} Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:07:58.099613 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:07:58.101023 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:07:58.102431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:07:58.102431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-30ed7568-7716-43e5-b35b-15da11d61199 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 404 len: 111 microversion: 2.1 time: 0.032939 Jun 07 05:07:58.102431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 542/1083] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:07:58 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:07:58.107872 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-184616cf-3f57-48ee-a266-ace1910030ee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '.version_select at 0x7f3d5f1613a0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:07:58.126864 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-184616cf-3f57-48ee-a266-ace1910030ee tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323808124" status: 202 len: 0 microversion: 2.1 time: 0.023115 Jun 07 05:07:58.127448 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 542/1084] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Jun 7 05:07:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323808124 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:07:58.755633 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-3025b838-97d2-4175-a8eb-5502aabe178d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: .version_select at 0x7f3d5de413a0>, body: {"keypair": {"name": "tempest-keypair-1985521892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrEFSFHwmvbW4mjbcJsYIHwvchgOKFbuQ8ZsoWS/O4+WYgIeqnw6EJFV4rslctC8xZY6FP7acdhgWnRl42m+IMSx3Hjg0rD8lJqbhQ+Xp6L1zKx4AT0x5rXkfthntuz/A=="}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:07:58.770219 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-3025b838-97d2-4175-a8eb-5502aabe178d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:07:58.774017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.quota [None req-3025b838-97d2-4175-a8eb-5502aabe178d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'key_pairs'} {{(pid=124421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:07:58.796949 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-3025b838-97d2-4175-a8eb-5502aabe178d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045394 Jun 07 05:07:58.797994 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 543/1085] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Jun 7 05:07:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:08:00.294525 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-357033683", "imageRef": "02132fd6-5705-4d0f-9707-9af682480ff0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae43a8ae-99bf-47b8-acdb-71f43fa74716"}], "security_groups": [{"name": "tempest-securitygroup--369729831"}], "key_name": "tempest-keypair-1985521892", "user_data": "}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:08:00.399511 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.network.neutron [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] validate_networks() for [('ae43a8ae-99bf-47b8-acdb-71f43fa74716', None, None, None, None, None)] {{(pid=124422) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 05:08:00.754680 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 05:08:00.755045 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image limits 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 05:08:00.755532 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Flavor pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 05:08:00.755943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Image pref 0:0:0 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 05:08:00.756386 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.virt.hardware [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 05:08:00.765185 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:00.765675 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:00.766481 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:00.766921 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:00.783919 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 05:08:00.787870 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.quota [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Getting quotas for user f9eeccdb31014f7ba8ba8a0cdb55f871 and project 983c02f261c94b9bb848bd1fd67eb94c. Resources: {'cores', 'instances', 'ram'} {{(pid=124422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 05:08:00.799523 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Going to run 1 instances... {{(pid=124422) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 05:08:00.801883 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02132fd6-5705-4d0f-9707-9af682480ff0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 05:08:00.846531 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fa7f87c2-4e3c-4d25-b779-099883fc5104 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556849 Jun 07 05:08:00.851860 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 543/1086] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Jun 7 05:08:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 05:08:00.857739 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e09d8952-d76d-4eaa-8cd1-af8e92349e4d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:00.858342 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-e09d8952-d76d-4eaa-8cd1-af8e92349e4d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:00.916202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-e09d8952-d76d-4eaa-8cd1-af8e92349e4d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:00.923940 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e09d8952-d76d-4eaa-8cd1-af8e92349e4d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1241 microversion: 2.1 time: 0.070726 Jun 07 05:08:00.924496 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 544/1087] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:00 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:01.940299 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:01.941499 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:01.948999 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:01.949818 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:01.950689 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:01.951225 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:02.017147 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:02.024638 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-b42a81b4-445b-43a8-9d6b-39e11a8711a1 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1299 microversion: 2.1 time: 0.088829 Jun 07 05:08:02.025900 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 544/1088] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:01 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:03.042966 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:03.043618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:03.050765 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:03.051160 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:03.052001 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:03.052480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:03.199516 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:03.208133 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-23baf563-5594-4f3a-97e3-169c049a2caa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.169870 Jun 07 05:08:03.216523 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 545/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:03 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:03.332742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-ffefe33a-6845-4f59-ad55-9b7d91773f31 req-377e1548-254c-4512-a5c5-28d53e75a654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058f68eb-aeb6-4616-86ad-7e47da5a088f", "tag": "88c016bc-cc3c-4387-b885-8130a43a842e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:08:03.345563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-ffefe33a-6845-4f59-ad55-9b7d91773f31 req-377e1548-254c-4512-a5c5-28d53e75a654 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:03.346088 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-ffefe33a-6845-4f59-ad55-9b7d91773f31 req-377e1548-254c-4512-a5c5-28d53e75a654 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:03.360223 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-ffefe33a-6845-4f59-ad55-9b7d91773f31 req-377e1548-254c-4512-a5c5-28d53e75a654 service nova] Creating event network-changed:88c016bc-cc3c-4387-b885-8130a43a842e for instance 058f68eb-aeb6-4616-86ad-7e47da5a088f on hv-cinder-83699 Jun 07 05:08:03.366750 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-ffefe33a-6845-4f59-ad55-9b7d91773f31 req-377e1548-254c-4512-a5c5-28d53e75a654 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047300 Jun 07 05:08:03.367879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 545/1090] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:08:04.225134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:04.225777 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:04.232420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:04.232874 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:04.233676 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:04.234123 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:04.363187 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:04.372414 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5bb16ec1-51d6-45ef-807c-37f3ff689fe9 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.151227 Jun 07 05:08:04.372985 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 546/1091] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:04 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:05.390622 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:05.391329 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:05.397555 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:05.398009 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:05.398774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:05.399215 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:05.528309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:05.535735 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-5db30774-6d88-4e12-ab9c-0b7a1a0da90e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.149836 Jun 07 05:08:05.536302 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 546/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:05 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:06.552047 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:06.552665 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:06.559162 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:06.559610 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:06.560371 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:06.560806 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:06.693255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:06.700849 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-727c9da3-de8e-47bc-a238-51a6934c13c0 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.152668 Jun 07 05:08:06.701456 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 547/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:06 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:07.768108 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:07.768732 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:07.774884 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:07.775339 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:07.776094 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:07.776562 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:07.906899 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:07.914380 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-a4507c64-3d49-4147-915e-c20920c31acc tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.200014 Jun 07 05:08:07.914948 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 547/1094] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:07 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:08.931912 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:08.932546 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:08.939203 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:08.939598 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:08.940366 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:08.940810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:09.065833 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:09.073450 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f7c54875-0dc2-46e9-a221-ef6da94137fa tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.145494 Jun 07 05:08:09.074017 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 548/1095] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:08 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:09.511193 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-5033b8c8-2a14-46e7-8985-10db02d225a6 req-803c6d34-f96e-4ec2-a9f0-bb6274de26c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058f68eb-aeb6-4616-86ad-7e47da5a088f", "name": "network-vif-plugged", "status": "completed", "tag": "88c016bc-cc3c-4387-b885-8130a43a842e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:08:09.520433 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-5033b8c8-2a14-46e7-8985-10db02d225a6 req-803c6d34-f96e-4ec2-a9f0-bb6274de26c7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:09.520879 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-5033b8c8-2a14-46e7-8985-10db02d225a6 req-803c6d34-f96e-4ec2-a9f0-bb6274de26c7 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:09.533626 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-5033b8c8-2a14-46e7-8985-10db02d225a6 req-803c6d34-f96e-4ec2-a9f0-bb6274de26c7 service nova] Creating event network-vif-plugged:88c016bc-cc3c-4387-b885-8130a43a842e for instance 058f68eb-aeb6-4616-86ad-7e47da5a088f on hv-cinder-83699 Jun 07 05:08:09.538539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-5033b8c8-2a14-46e7-8985-10db02d225a6 req-803c6d34-f96e-4ec2-a9f0-bb6274de26c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 Jun 07 05:08:09.539126 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 548/1096] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:08:10.090302 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:10.090922 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:10.097341 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:10.097788 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:10.098545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:10.098981 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:10.230269 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:10.237521 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bd04eb92-db2f-4eb2-b8f5-add6ba832295 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1366 microversion: 2.1 time: 0.151431 Jun 07 05:08:10.238091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 549/1097] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:10 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:11.255256 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:11.255943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:11.258346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:08:11.259563 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell0:SELECT=6 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:08:11.265575 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:11.266027 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:11.266785 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:11.267219 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:11.398762 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:08:11.406218 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-eff4fda5-c9d5-48ba-9eda-1b82c91e9925 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1557 microversion: 2.1 time: 0.155517 Jun 07 05:08:11.406774 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 549/1098] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:08:11 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:08:11.424896 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:08:11.425453 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:08:11.427473 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell0:SELECT=6 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:08:11.435093 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:11.435545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:11.436651 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:11.436775 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:11.513993 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-2ae775e4-1f36-498b-8c0e-3c54ddb8fe0f tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095164 Jun 07 05:08:11.514591 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 550/1099] 10.222.0.40 () {58 vars in 1274 bytes} [Tue Jun 7 05:08:11 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:08:12.426909 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-439017c4-c192-4a1d-b3e2-0c73b8636b80 req-23cd2ae8-93c6-4906-a74c-e13aa36dffec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058f68eb-aeb6-4616-86ad-7e47da5a088f", "tag": "88c016bc-cc3c-4387-b885-8130a43a842e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:08:12.436346 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-439017c4-c192-4a1d-b3e2-0c73b8636b80 req-23cd2ae8-93c6-4906-a74c-e13aa36dffec service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:08:12.436793 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-439017c4-c192-4a1d-b3e2-0c73b8636b80 req-23cd2ae8-93c6-4906-a74c-e13aa36dffec service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:08:12.448509 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-439017c4-c192-4a1d-b3e2-0c73b8636b80 req-23cd2ae8-93c6-4906-a74c-e13aa36dffec service nova] Creating event network-changed:88c016bc-cc3c-4387-b885-8130a43a842e for instance 058f68eb-aeb6-4616-86ad-7e47da5a088f on hv-cinder-83699 Jun 07 05:08:12.453637 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-439017c4-c192-4a1d-b3e2-0c73b8636b80 req-23cd2ae8-93c6-4906-a74c-e13aa36dffec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030231 Jun 07 05:08:12.454255 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 550/1100] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:27.843586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:27.844378 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:27.848931 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:27.849444 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:27.858774 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:27.859223 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:27.859991 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:27.860578 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:27.885716 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-bb7f01ee-bc84-45cb-8854-c5be68329212 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/ips" status: 200 len: 149 microversion: 2.1 time: 0.044003 Jun 07 05:09:27.886287 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 551/1101] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:09:27 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:29.194571 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:29.195309 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:29.200684 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37da5f2c-0344-4f47-b5d9-80f97e19a62c"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:09:29.201849 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:29.209624 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:29.210078 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:29.210844 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:29.211277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:29.460338 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c738cedc-b160-4692-b2e6-b9a651a8f936 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "POST /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267494 Jun 07 05:09:29.460939 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 551/1102] 10.222.0.40 () {60 vars in 1322 bytes} [Tue Jun 7 05:09:29 2022] POST /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:37.045557 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:37.046098 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:37.052380 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:37.052826 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:37.053606 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:37.054035 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:37.133178 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.objects.instance [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lazy-loading 'services' on Instance uuid 058f68eb-aeb6-4616-86ad-7e47da5a088f {{(pid=124421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 05:09:37.205242 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6cc7c5c6-7a86-42cb-a31d-98672dd88a63 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments/37da5f2c-0344-4f47-b5d9-80f97e19a62c" status: 202 len: 0 microversion: 2.1 time: 0.163377 Jun 07 05:09:37.205828 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 552/1103] 10.222.0.40 () {58 vars in 1415 bytes} [Tue Jun 7 05:09:37 2022] DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments/37da5f2c-0344-4f47-b5d9-80f97e19a62c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:09:37.215649 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:37.216720 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:37.222905 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:37.223399 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:37.224220 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:37.224704 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:37.255476 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-e97d3633-42ef-454c-a14c-7bc39b95b54b tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Jun 07 05:09:37.256026 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 552/1104] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:09:37 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:38.268947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:38.269953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:38.277038 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.277523 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.278273 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.278703 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.306167 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-6110cbb5-03a8-45d0-a2f6-cd2b4c5937d3 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042233 Jun 07 05:09:38.306714 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 553/1105] 10.222.0.40 () {58 vars in 1301 bytes} [Tue Jun 7 05:09:38 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 05:09:38.362196 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:38.362714 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:38.369037 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.369520 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.370271 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.370700 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.395124 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Going to try to terminate instance {{(pid=124422) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 05:09:38.470012 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-dfabbca9-c815-4806-981c-76c0895d5cba tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 204 len: 0 microversion: 2.1 time: 0.110961 Jun 07 05:09:38.470874 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 553/1106] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:09:38 2022] DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 05:09:38.480175 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:38.480798 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:38.486822 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.487274 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.488119 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:38.488558 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:38.621545 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:09:38.629143 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-f7a11273-012e-4e8b-ad20-0be0b9d835be tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1680 microversion: 2.1 time: 0.152913 Jun 07 05:09:38.629740 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 554/1107] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:38 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:09:39.646993 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:39.647693 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:39.655169 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:39.655622 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:39.656385 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:39.656825 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:39.789034 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.policy [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124422) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:09:39.797434 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-80a4a9a3-fb88-46c6-8de0-3f1ca735026e tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1680 microversion: 2.1 time: 0.154661 Jun 07 05:09:39.797997 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 554/1108] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:39 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:09:40.814519 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:40.815136 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:40.821584 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:40.822331 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:40.823106 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:40.823552 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:40.890776 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.policy [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eeccdb31014f7ba8ba8a0cdb55f871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c02f261c94b9bb848bd1fd67eb94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124421) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 05:09:40.903284 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-0beb5c21-7056-4b0e-b64b-af25b8207d23 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 200 len: 1613 microversion: 2.1 time: 0.092513 Jun 07 05:09:40.904058 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 555/1109] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:40 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 1613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 05:09:41.257000 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [req-1a53c879-9fea-418f-befc-11cd6e0a4f68 req-e038613e-390a-41af-b6dd-18b93812a1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058f68eb-aeb6-4616-86ad-7e47da5a088f", "name": "network-vif-deleted", "tag": "88c016bc-cc3c-4387-b885-8130a43a842e"}]} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:09:41.266038 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-1a53c879-9fea-418f-befc-11cd6e0a4f68 req-e038613e-390a-41af-b6dd-18b93812a1e4 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:41.266417 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [req-1a53c879-9fea-418f-befc-11cd6e0a4f68 req-e038613e-390a-41af-b6dd-18b93812a1e4 service nova] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:41.278621 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.compute.server_external_events [req-1a53c879-9fea-418f-befc-11cd6e0a4f68 req-e038613e-390a-41af-b6dd-18b93812a1e4 service nova] Creating event network-vif-deleted:88c016bc-cc3c-4387-b885-8130a43a842e for instance 058f68eb-aeb6-4616-86ad-7e47da5a088f on hv-cinder-83699 Jun 07 05:09:41.283539 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [req-1a53c879-9fea-418f-befc-11cd6e0a4f68 req-e038613e-390a-41af-b6dd-18b93812a1e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119718 Jun 07 05:09:41.284144 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 555/1110] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Jun 7 05:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:41.920150 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:41.920856 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:41.927784 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:41.927958 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:41.928728 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:41.929163 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:41.944235 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f HTTP/1.1 Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:41.945927 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:41.948527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '058f68eb-aeb6-4616-86ad-7e47da5a088f'} Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:41.949667 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:41.951158 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:41.952885 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:41.952885 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-cf072440-2eb6-4964-8fa5-c9085a3b1862 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 404 len: 111 microversion: 2.1 time: 0.031715 Jun 07 05:09:41.952885 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 556/1111] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:41 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:41.958754 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9acf0d51-1bfa-4af0-9825-68ef8cb9b9ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '.version_select at 0x7f3d5db30af0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:41.979753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9acf0d51-1bfa-4af0-9825-68ef8cb9b9ef tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985521892" status: 202 len: 0 microversion: 2.1 time: 0.024931 Jun 07 05:09:41.980349 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 556/1112] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Jun 7 05:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985521892 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:09:44.219756 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:44.220262 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:44.226720 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:44.227169 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:44.227945 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:44.228373 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:44.241562 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f HTTP/1.1 Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:44.243081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.245340 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '058f68eb-aeb6-4616-86ad-7e47da5a088f'} Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:44.246298 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.248110 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.249858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:44.249858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7e327b6b-2c0a-4156-99a7-e8d8177c5380 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 404 len: 111 microversion: 2.1 time: 0.029245 Jun 07 05:09:44.249858 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 557/1113] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:09:44 2022] DELETE /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:44.254121 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:44.254911 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 058f68eb-aeb6-4616-86ad-7e47da5a088f] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:44.261692 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:44.262135 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:44.262885 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:44.263314 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:44.278519 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f HTTP/1.1 Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:44.280122 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.281907 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '058f68eb-aeb6-4616-86ad-7e47da5a088f'} Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:44.283118 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. Jun 07 05:09:44.285503 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:44.287117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 058f68eb-aeb6-4616-86ad-7e47da5a088f could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:44.287117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d15c5b47-4a40-4acd-9818-c28860102202 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f" status: 404 len: 111 microversion: 2.1 time: 0.034045 Jun 07 05:09:44.287117 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 557/1114] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:44 2022] GET /compute/v2.1/servers/058f68eb-aeb6-4616-86ad-7e47da5a088f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:45.416683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:45.417198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:45.423631 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.424081 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.424839 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.425308 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.440394 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 HTTP/1.1 Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:45.441953 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.443690 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '06150f1f-862a-46ba-9d06-ed8aceb7c462'} Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:45.444853 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.447271 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.448905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:45.448905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c22c58a5-aca8-4f1a-ba04-684a89cb4650 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 404 len: 111 microversion: 2.1 time: 0.030443 Jun 07 05:09:45.448905 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 558/1115] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:09:45 2022] DELETE /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:45.452230 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:45.452848 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 06150f1f-862a-46ba-9d06-ed8aceb7c462] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:45.459581 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.460030 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.460802 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.461247 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.474810 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 HTTP/1.1 Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:45.476306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.478067 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '06150f1f-862a-46ba-9d06-ed8aceb7c462'} Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:45.479290 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. Jun 07 05:09:45.481010 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.482486 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 06150f1f-862a-46ba-9d06-ed8aceb7c462 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:45.482486 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-59546c91-d7a2-4659-b9ae-aec7bb1831c6 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462" status: 404 len: 111 microversion: 2.1 time: 0.029364 Jun 07 05:09:45.482486 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 558/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:45 2022] GET /compute/v2.1/servers/06150f1f-862a-46ba-9d06-ed8aceb7c462 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:45.486243 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:45.486747 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:45.494527 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.494971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.495762 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.496198 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.510400 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 HTTP/1.1 Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:45.511924 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.513673 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '6fa4f287-a21c-4d24-841b-90f6245fbb55'} Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:45.514799 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.516541 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.518202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:45.518202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a7722c5f-6fc1-458c-9a0a-2254ef1d180d tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 404 len: 111 microversion: 2.1 time: 0.030946 Jun 07 05:09:45.518202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 559/1117] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:09:45 2022] DELETE /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:45.521334 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:45.521943 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 6fa4f287-a21c-4d24-841b-90f6245fbb55] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:45.528070 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.528521 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.529306 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:45.529745 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:45.542845 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 HTTP/1.1 Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:45.544337 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.546080 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '6fa4f287-a21c-4d24-841b-90f6245fbb55'} Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:45.547213 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. Jun 07 05:09:45.548833 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:45.550744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 6fa4f287-a21c-4d24-841b-90f6245fbb55 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:45.550744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c1820fbe-bf21-4740-8737-0156c931cfec tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55" status: 404 len: 111 microversion: 2.1 time: 0.028143 Jun 07 05:09:45.550744 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 559/1118] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:45 2022] GET /compute/v2.1/servers/6fa4f287-a21c-4d24-841b-90f6245fbb55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:46.679048 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:46.679568 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.compute.api [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124421) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:46.686217 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:46.686669 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:46.687431 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:46.687869 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG oslo_concurrency.lockutils [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:46.702202 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 HTTP/1.1 Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:46.703730 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: > Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.705618 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08'} Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:46.706586 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.707989 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.709458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:46.709458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-c63a9d47-4fa3-45c7-b23a-5b47d6caccfd tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 404 len: 111 microversion: 2.1 time: 0.029862 Jun 07 05:09:46.709458 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 560/1119] 10.222.0.40 () {58 vars in 1238 bytes} [Tue Jun 7 05:09:46 2022] DELETE /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:46.714785 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Calling method '>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:46.715397 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.compute.api [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] [instance: 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08] Fetching instance by UUID {{(pid=124422) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 05:09:46.721806 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:46.722253 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:46.723001 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 05:09:46.723430 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG oslo_concurrency.lockutils [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Lock "a1dc69df-38a5-40ed-9acc-d36dd1c5c2c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 05:09:46.739436 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] HTTP exception thrown: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Request method failure captured: Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 HTTP/1.1 Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABintwLrQq1K0k6rRrG0vOSfk31a9UoUCJseBWJCH_sC45WRO966u9Y9m-tHDIXOfU635U1SHmvXtFR2ZtLBPIaC16x_nZAu-MaMfQK9DOITIHbwxv4Kq7jEdCkPBSBE_b4GQPQCIeN3DUVQkMjppI0mSKO2s515t-5qvlwCJcTj0HsZIM Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:46.740946 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_983c02f261c94b9bb848bd1fd67eb94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/983c02f261c94b9bb848bd1fd67eb94c"}]}] Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: 983c02f261c94b9bb848bd1fd67eb94c Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967279306 Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: f9eeccdb31014f7ba8ba8a0cdb55f871 Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-AttachVolumeNegativeTest-967279306-project Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: > Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.742753 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08'} Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:46.743933 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. Jun 07 05:09:46.745623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:46.747438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] Returning 404 to user: Instance 7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:46.747438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-63174bae-bc91-42b4-a870-6fe23d0d7c60 tempest-AttachVolumeNegativeTest-967279306 tempest-AttachVolumeNegativeTest-967279306-project] 10.222.0.40 "GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08" status: 404 len: 111 microversion: 2.1 time: 0.032606 Jun 07 05:09:46.747438 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 560/1120] 10.222.0.40 () {58 vars in 1235 bytes} [Tue Jun 7 05:09:46 2022] GET /compute/v2.1/servers/7502ba8f-0ee0-40ec-9be9-0f9e9ed02c08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:50.904130 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-a9dd1845-5603-4e13-ac92-4092849d4484 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Action: 'create', calling method: .version_select at 0x7f3d5daa2f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-216209683"}} {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:09:51.199148 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-a9dd1845-5603-4e13-ac92-4092849d4484 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.408960 Jun 07 05:09:51.199810 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 561/1121] 10.222.0.40 () {60 vars in 1154 bytes} [Tue Jun 7 05:09:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 05:09:51.210779 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c2b121e2-784e-4d5c-897d-a7d3e3dd4d2c tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db25a60>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:51.264146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c2b121e2-784e-4d5c-897d-a7d3e3dd4d2c tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 200 len: 344 microversion: 2.1 time: 0.057245 Jun 07 05:09:51.264717 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 561/1122] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 05:09:51 2022] GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:52.277091 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-1d27e01a-ab8b-4d0b-a71b-7bc1d860e77b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5da3f940>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:52.336103 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-1d27e01a-ab8b-4d0b-a71b-7bc1d860e77b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 200 len: 345 microversion: 2.1 time: 0.063912 Jun 07 05:09:52.336663 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 562/1123] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 05:09:52 2022] GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:52.348980 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-c8a526ce-0bfb-44dc-9794-79ab7d688e33 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Action: 'create', calling method: .version_select at 0x7f3d5db30160>, body: {"snapshot": {"volume_id": "6bcdce3b-fac1-41f1-83a6-e58e32a89cdc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-568929182"}} {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 05:09:52.499636 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-c8a526ce-0bfb-44dc-9794-79ab7d688e33 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.154792 Jun 07 05:09:52.500231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 562/1124] 10.222.0.40 () {60 vars in 1161 bytes} [Tue Jun 7 05:09:52 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:52.511317 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-e0f9da0e-9bc9-4bc5-ae3b-818421bf83c9 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5dac1dc0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:52.544164 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-e0f9da0e-9bc9-4bc5-ae3b-818421bf83c9 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.037802 Jun 07 05:09:52.544803 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 563/1125] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:52 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:52.554180 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-66fb540c-33b4-46cb-9532-446f2fc45a31 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db25670>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:52.583742 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-66fb540c-33b4-46cb-9532-446f2fc45a31 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033152 Jun 07 05:09:52.584432 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 563/1126] 10.222.0.40 () {58 vars in 1139 bytes} [Tue Jun 7 05:09:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:52.595668 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-5d2f5e14-8375-4cdb-bc0a-fcef26bf09ef tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5daa2670>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:52.628757 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-5d2f5e14-8375-4cdb-bc0a-fcef26bf09ef tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.037062 Jun 07 05:09:52.629683 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 564/1127] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:52 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:53.642048 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d40fb09e-0cc4-4349-9db3-4b3cf321ca61 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db300d0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:53.671566 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d40fb09e-0cc4-4349-9db3-4b3cf321ca61 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.033757 Jun 07 05:09:53.672115 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 564/1128] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:53 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:54.682835 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-92d2bd6f-f269-4d61-b378-f066bc9f956d tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db16160>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:54.711395 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-92d2bd6f-f269-4d61-b378-f066bc9f956d tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.032981 Jun 07 05:09:54.713131 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 565/1129] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:54 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:55.724262 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-7903ee74-42c0-42bd-bfd4-f3214e11dbbc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db22ca0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:55.756855 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-7903ee74-42c0-42bd-bfd4-f3214e11dbbc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.036807 Jun 07 05:09:55.757450 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 565/1130] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:55 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:56.766554 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_api:SELECT=20 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:56.767296 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG dbcounter [-] [124421] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:56.771321 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d344f8ae-c238-4d50-b4e4-0ce8dc884847 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5dacc700>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:56.801376 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d344f8ae-c238-4d50-b4e4-0ce8dc884847 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 287 microversion: 2.1 time: 0.036201 Jun 07 05:09:56.801938 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 566/1131] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:56 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:56.809356 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:56.810553 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG dbcounter [-] [124422] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 05:09:56.814407 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-9fe1c3c8-8c17-410f-9fc4-7b5416177bec tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db320d0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:56.870231 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-9fe1c3c8-8c17-410f-9fc4-7b5416177bec tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 202 len: 0 microversion: 2.1 time: 0.061591 Jun 07 05:09:56.870873 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 566/1132] 10.222.0.40 () {58 vars in 1253 bytes} [Tue Jun 7 05:09:56 2022] DELETE /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 05:09:56.879059 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-7568d81e-3755-468c-8483-12a8ee97f6ab tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db16790>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:56.909654 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-7568d81e-3755-468c-8483-12a8ee97f6ab tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 200 len: 286 microversion: 2.1 time: 0.034551 Jun 07 05:09:56.910253 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 567/1133] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:56 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:57.921390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fabf92d7-29a2-46fd-bc38-97b268e7dd7b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db253a0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:57.945107 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-fabf92d7-29a2-46fd-bc38-97b268e7dd7b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] HTTP exception thrown: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fabf92d7-29a2-46fd-bc38-97b268e7dd7b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Request method failure captured: Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 HTTP/1.1 Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABint2e1chavwTfvhykLNfpPsngNEP-JjRTwl9ts9QQd-4RzWmuNjCLAonMDLqRT_rsngv76h5U6shjeMHafkP1DDGKs4XzeISThHStKkm0oOlqgkd8GBBu5XgzU5ZuG8i-NyXs91cu9mX_mjR4mbSE33iEew3TUXMphVrxIVHEy6XFSnI Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:57.948243 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d977856116d54c558b9cec3361e50f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}] Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: c5e1bff4f2df4cefa3b0d60a06f0fab3 Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': 'd60fbb9c-a590-4114-937b-4e8ca0dfc336'} Jun 07 05:09:57.950176 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. (HTTP 404) (Request-ID: req-5a4243ba-2053-4ea8-a0b5-81982f3c02c8) Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.951390 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:57.952985 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 05:09:57.954623 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-fabf92d7-29a2-46fd-bc38-97b268e7dd7b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Returning 404 to user: Snapshot d60fbb9c-a590-4114-937b-4e8ca0dfc336 could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:57.956415 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-fabf92d7-29a2-46fd-bc38-97b268e7dd7b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336" status: 404 len: 111 microversion: 2.1 time: 0.032517 Jun 07 05:09:57.957618 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 567/1134] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Jun 7 05:09:57 2022] GET /compute/v2.1/os-snapshots/d60fbb9c-a590-4114-937b-4e8ca0dfc336 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:57.958425 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-d3f10e25-7384-4221-a745-25616d41f12f tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5daa2af0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:58.017555 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-d3f10e25-7384-4221-a745-25616d41f12f tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 202 len: 0 microversion: 2.1 time: 0.063124 Jun 07 05:09:58.018127 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 568/1135] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:09:57 2022] DELETE /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 05:09:58.026710 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-0cae00a6-ba19-4147-8981-0b8fd5fb6f3d tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5db30b80>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:58.072516 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-0cae00a6-ba19-4147-8981-0b8fd5fb6f3d tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 200 len: 344 microversion: 2.1 time: 0.050153 Jun 07 05:09:58.073044 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 568/1136] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 05:09:58 2022] GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 05:09:59.085417 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ee024779-59e8-4a82-8878-4fc94f13e0bc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5fb638b0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:59.113500 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-ee024779-59e8-4a82-8878-4fc94f13e0bc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] HTTP exception thrown: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ee024779-59e8-4a82-8878-4fc94f13e0bc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Request method failure captured: Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc HTTP/1.1 Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABint2e1chavwTfvhykLNfpPsngNEP-JjRTwl9ts9QQd-4RzWmuNjCLAonMDLqRT_rsngv76h5U6shjeMHafkP1DDGKs4XzeISThHStKkm0oOlqgkd8GBBu5XgzU5ZuG8i-NyXs91cu9mX_mjR4mbSE33iEew3TUXMphVrxIVHEy6XFSnI Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:59.115448 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d977856116d54c558b9cec3361e50f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}] Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: c5e1bff4f2df4cefa3b0d60a06f0fab3 Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '6bcdce3b-fac1-41f1-83a6-e58e32a89cdc'} Jun 07 05:09:59.117255 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. (HTTP 404) (Request-ID: req-86b59720-2ca4-45e9-8711-014187414dd3) Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.118947 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:59.120407 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 05:09:59.121840 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-ee024779-59e8-4a82-8878-4fc94f13e0bc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Returning 404 to user: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-ee024779-59e8-4a82-8878-4fc94f13e0bc tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 404 len: 109 microversion: 2.1 time: 0.035821 Jun 07 05:09:59.123381 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 569/1137] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 05:09:59 2022] GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:09:59.131444 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d82a68e4-a7a6-4ade-9c0b-98f43290e68b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5ddb4ee0>' {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:59.159089 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.wsgi [None req-d82a68e4-a7a6-4ade-9c0b-98f43290e68b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] HTTP exception thrown: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d82a68e4-a7a6-4ade-9c0b-98f43290e68b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Request method failure captured: Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: request: DELETE /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc HTTP/1.1 Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept: application/json Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Accept-Encoding: identity Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Connection: close Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Length: 0 Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Content-Type: application/json Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Host: 10.222.0.40 Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Openstack-System-Scope: None Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Auth-Token: gAAAAABint2e1chavwTfvhykLNfpPsngNEP-JjRTwl9ts9QQd-4RzWmuNjCLAonMDLqRT_rsngv76h5U6shjeMHafkP1DDGKs4XzeISThHStKkm0oOlqgkd8GBBu5XgzU5ZuG8i-NyXs91cu9mX_mjR4mbSE33iEew3TUXMphVrxIVHEy6XFSnI Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Id: None Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Domain-Name: None Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Identity-Status: Confirmed Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Is-Admin-Project: True Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Id: default Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Domain-Name: Default Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Role: member,reader Jun 07 05:09:59.161019 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Roles: member,reader Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d977856116d54c558b9cec3361e50f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}] Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Id: default Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Domain-Name: Default Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Id: c5e1bff4f2df4cefa3b0d60a06f0fab3 Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: method: Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: exception: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: action_args: {'id': '6bcdce3b-fac1-41f1-83a6-e58e32a89cdc'} Jun 07 05:09:59.162778 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: {{(pid=124422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. (HTTP 404) (Request-ID: req-36832312-fc11-4631-907d-5e8ecbe4f0fc) Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.163775 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 05:09:59.167277 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 05:09:59.169006 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: DEBUG nova.api.openstack.wsgi [None req-d82a68e4-a7a6-4ade-9c0b-98f43290e68b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Returning 404 to user: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. {{(pid=124422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO nova.api.openstack.requestlog [None req-d82a68e4-a7a6-4ade-9c0b-98f43290e68b tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 404 len: 109 microversion: 2.1 time: 0.035460 Jun 07 05:09:59.170596 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: [pid: 124422|app: 0|req: 569/1138] 10.222.0.40 () {58 vars in 1247 bytes} [Tue Jun 7 05:09:59 2022] DELETE /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 05:09:59.171882 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-074dee8b-aef8-406c-be63-2966fa7c4788 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Calling method '.version_select at 0x7f3d5daa25e0>' {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 05:09:59.198726 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.wsgi [None req-074dee8b-aef8-406c-be63-2966fa7c4788 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] HTTP exception thrown: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-074dee8b-aef8-406c-be63-2966fa7c4788 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Request method failure captured: Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: request: GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc HTTP/1.1 Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept: application/json Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Accept-Encoding: identity Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Connection: close Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Length: 0 Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Content-Type: application/json Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Host: 10.222.0.40 Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Openstack-System-Scope: None Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: User-Agent: python-urllib3/1.26.9 Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Auth-Token: gAAAAABint2e1chavwTfvhykLNfpPsngNEP-JjRTwl9ts9QQd-4RzWmuNjCLAonMDLqRT_rsngv76h5U6shjeMHafkP1DDGKs4XzeISThHStKkm0oOlqgkd8GBBu5XgzU5ZuG8i-NyXs91cu9mX_mjR4mbSE33iEew3TUXMphVrxIVHEy6XFSnI Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Id: None Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Domain-Name: None Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Identity-Status: Confirmed Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Is-Admin-Project: True Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Id: default Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Domain-Name: Default Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Role: member,reader Jun 07 05:09:59.200649 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Roles: member,reader Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d977856116d54c558b9cec3361e50f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d977856116d54c558b9cec3361e50f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d977856116d54c558b9cec3361e50f1f"}]}] Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Id: d977856116d54c558b9cec3361e50f1f Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109604515 Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Id: default Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Domain-Name: Default Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Id: c5e1bff4f2df4cefa3b0d60a06f0fab3 Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109604515-project Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: method: Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: exception: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: action_args: {'id': '6bcdce3b-fac1-41f1-83a6-e58e32a89cdc'} Jun 07 05:09:59.202489 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: {{(pid=124421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. (HTTP 404) (Request-ID: req-f9db73f0-f0a8-4e8f-8330-d348fac52f8e) Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.203599 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 05:09:59.205174 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 05:09:59.207134 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: ERROR nova.api.openstack.wsgi Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: DEBUG nova.api.openstack.wsgi [None req-074dee8b-aef8-406c-be63-2966fa7c4788 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] Returning 404 to user: Volume 6bcdce3b-fac1-41f1-83a6-e58e32a89cdc could not be found. {{(pid=124421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO nova.api.openstack.requestlog [None req-074dee8b-aef8-406c-be63-2966fa7c4788 tempest-VolumesSnapshotsTestJSON-109604515 tempest-VolumesSnapshotsTestJSON-109604515-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc" status: 404 len: 109 microversion: 2.1 time: 0.034186 Jun 07 05:09:59.209192 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: [pid: 124421|app: 0|req: 570/1139] 10.222.0.40 () {58 vars in 1244 bytes} [Tue Jun 7 05:09:59 2022] GET /compute/v2.1/os-volumes/6bcdce3b-fac1-41f1-83a6-e58e32a89cdc => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 05:10:23.623970 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:10:23.624652 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:10:31.152279 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:10:31.152984 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:12:28.172420 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:12:28.173102 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:12:36.372257 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:12:36.372910 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:13:43.632352 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:13:43.632971 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:13:51.159934 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:13:51.160480 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:13:56.591465 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:13:56.592042 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:14:57.613492 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:14:57.614319 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:15:48.180041 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:15:48.180679 dv-cinder-836996-30-iscsi devstack@n-api.service[124421]: Tue Jun 7 05:15:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 05:15:56.381146 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 05:15:56.381733 dv-cinder-836996-30-iscsi devstack@n-api.service[124422]: Tue Jun 7 05:15:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!